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ABSTRACT 

The Civil Service Reform Act of 1978 created the 

merit pajL system and cash award program for federal super visors and 
management officials in General Schedule grades 13 through lS.T^is 
report assesses the implementation and operation of merit pay for 
fiscal years -1981 and 1982 at three departmerits--Agriculture Housing 
and Urban Development, and Nsivy-- that employed 28*000 employees under 
merit pay systems (25 percent of all federal merit pay employees ) . 
Data analyzed in the reprbt are from interviews with officials, 
reviews of performance appraisal and pay statistics, analysis of 
performance ratings of 475 employees, and questionnaires administered 
to a sample of merit pay employees . The study also separated out and 

analyzed the responses of top performers. Several areas requiring 

management attention were discovered: ( 1) factors other than employee 
performance have i nf luenced the amount of merit pay employees have 
received; (2) both the performance standards and the procedures used 
to establi sh them need to be improved; ( Of f ice of Personnel 
Management efforts to evaluate agencies' merit pay programs have bean 
limited in, scope, but are improving; and |4 ) employee perceptions or 
the merit pay program were low. Half of the document is composed of 
13 appendixes. (MLF) 
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BY THE. COMPTROLLER 'GENERAL . . ' 

Report To The Chairwoman, 

Subcommittee On Compensation And Employee Benefits 
Committee On Post Office And Civil Service , 
House Of Representatives 

of the United states 



A 2-Yeyar Appraisal Of Merit Pay 
In Three Agencies 



The Civil Service Reform Act of 1 978 requires agenciesto establish a 
merit pay system for management officials and supervisors in grades 
1 3 through 1 5. GAO's review of the 1 981 and 1 982 merit pay cycles 
in three agencies employing about 25 percent of the total federal 
merit pay population found several areas requiring management 
attention. .° 

-A number of factors other than employee performance have 
influenced the amount of merit pay employees received: 

- Although performance standards were better in 1 982 than in 
1 981 , both the standards and.^hje procedures used to establish 
them need to be improved. 

"OPM efforts to evaluate agencies' merit pay programs have 
been limited in scope, but recent initiatives to strengthen these 
efforts are a step in the right direction. 



- Employee perceptions^ the merit pay program were low. 

The agencies involved, the Departments of Navy, Agriculture, arid 
Housing and Urban Development, and the Office of Personnel 
Management, reviewed a draft of this report and generally agreed 
with its conclusions and recommendations. 
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The Honorable Mary Rose Dakar 
Chairwoman, Subcommittee dn 

^Compensation and Employee Benefits 
Committee 0Y1 Post Office and ./ 

Civil Service 
Bougie of Representatives 

Dear Madam Chairwoman 2 , 

This 0 report, in response to your request, assesses thf 
merit pay experiences of tKe Departments of Agriculture* Navy* 
and Housing arid Urban Development during* 1981 anS 1982. 

The report also makes recdmmehd^tiohs to the Director, 
Office of Personnel Management * for ensuring greater equity in 
performance ratings and pay in ah effort to improve employee ^ 
acceptance _6f th^ifierit pay system. ' \ 

yAs arranged with your office, unless you publicly announce 

it contents earlier , we plan no further distribution of this 

report. until 7 days after the date of the report. At that time, 
we will send^ copies to interested .parties and make copies 
available to others upon request. 



Sincerely yours* 




Comptroller General 
of the United States 
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COMPTROLLER GENERAL 1 S REPORT A 2-YEAR APPRAISAL OF 

TO THE CHAIRWOMAN, SUBCOMMITTEE MERIT PAY IN THREE 

ON COMPENSATION AND EMPLOYEE AGENCIES 
BENEFITS,, COMMITTEE ON POST 
OFFICE- AND CIVIL SERVICE 
HOUSE OF REPRESENTATIVES 

D I_ G E S^ T i> 

7__'__ _ _ _ _ _ _ _ __ ___ 

The Civil, Service Reform Act (CSRA) of ±978 
created the merit pay system and cash award , 
1 program for federal supervisors and management 
officials in General Schedule grades 13 
• " through 15^ In fiscal year 1982, about - 

-108, 000 • employees were covered by merit pay. 
(About 80, 000 GS-13's through 15 1 s were hot 
designated as managers or supervisors . ) Merit 
pay employees are hot guaranteed the annual 
salary adjustments that most General Schedule 
o employees receive . Instead , under this^sys- 
; tern, which became effective goverrimehtwide in 

October .1981, merit pay employees ' are 
guaranteed only half the annual adjustment ; 
the other Half of -the adjustment along with 7 
their within-grade .increases goes to a fund 
for a particular 'organizational group called a 
merit pay pool Employees within the pool'* 
compete with each ot^her, based on thoJLr per- 
formance ratings, fon permanent salary in- 
creases to be pdftd from the merit pay fund. 1 

: 

The Chairwoman, Subcommittee on Compensation 
and Employee Benefits, Housl Committee on Post 
Office and Civil Service, agked GAO to review 
ageijcy experience^ with the transition to % 
merit pay. This Report assesses its implemen- 
tation and operation fdr fiscal years 1981 and 
1982 at three Departments having about 25 per- 
cent of all 'federal merit pay employees: 
. Agriculture, Housing and Urban Development, 
and the Navy; (See p. 1. ) 

A major .concern of -merit pay employees has 
been that they are nor guaranteed. the full ah- ■ 
nual adjustment and within-grade increases. J 
About half the merit pay employees surveyed by ^ 
GAO in 1981 and 1982 wanted to return to the 
General Schedule for their annual and within- 
grade pa^ increases rather than* remain under 
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merit pay as implemented in their agencies. 
Among the agencies' top performers who re- 
ceive<5 the highest ratings between 28 and 42 
percent ih_ each agency wanted to return to the 
General Schedule.. About 40 percent of the em- 
ployees, support the concept of merit pay but 
many believe it has not been administered 
fairly and should bfe revised. (See pp; 49 to 
50 and app; III . ) 

The Office of Personnel Management (OPM) has 
proposed regulations that would alter the 
merit pay program. Also, members of the Con- 
gress have introduced legislation that would 
make basic changes to the jnerit pay system. 
Both the proposed' regulations arid the legisla- 
tion would guarantee the entire annual pay ad- 
justment for employees rated satisfactory or 

.better,. In addition^ 0PM \s proposed regula- 
tions that were scheduled to go into effect 
November 25, 1983, would have guaranteed these 
employees the equivalent of the wi thin-grade 
increase they would have received under the 
General Schedule . The proposed regulations 

0 also contained changes to the government 1 s 
reduction- in- force rules, and the Congress 
enacted legislation to block the* implementa- 
tion of .the regulations . In response to a 
suit by „ the National Treasury Employees Union, 
and while the* Congress was adjourned, on 
December 30, 1983, the^ regulations were 
declared null and void' by the U. S. -District 
Court, and OPft was enjoined from directly or 
indirectly implementing them. (See pp. 54 to 
55.) 

NONPERFORMANCE -RELATED FACTORS 
IW* CURRENT MERIT PAY / PRACTICES 

The CSRA requires that agencies establish 
merit pay systems which shall f - 

"use performance appraisals as the 
basis for determining mejy.t pay 
adjustments . " 

However, other factors unrelated to em pl9Y e f 
performance can influence ; merit pay increases 
and may never be completely eliminated • GAO 1 s 
revjueW showed that a number of nonperformance^ 
f actio rs hav^ influenced the size of merit 
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increases awarded to individual employees more 
than is necessary. These factors have also 
contributed to negative employee perceptions 
of merit pay, even among the top performers 
who received the largest payouts. Among these 
factors were ( 1 ) inconsistencies among raters, 
(2) the distribution of ratings within the 
merit pay pool over the 'various performance 
levels, (3) the grades and types of employees 
in the merit pay pool , and (4) ( agencies 
formulas for distributing increases. (See 
pp. 6, 7, 14, and 19. j , ; -s 

In judging performance, some supervisors lire 
lenient at)d some are strict ; _this has a direct 
bearing on the consistency of ratings and the 
eventual size of merit pay increases. Con-' , ^ 
sistency between raters can be a concern 
because of differences in perspectives of dif- 
ferent supervisors . However, since the.advent 
of merit pay , these differences assume grfeater, 
significance because the employee?' merit. in- 
creases are tied directly to the appraisal. 
(S^e p. 6.) , . 

The way ratings are distributed among mftnbers 
of a particular merit pay pool affects the - 
size df_the itterit pay increases for pool mem- 
bers. For 'Instance /_ If a merit pay pool con- 
tained only a few employees rated^ at the 
highest level, the merit pay increases would 
*be more for the£e pool members than if the 
pool contained many employees rated in the 
highest category. OPM' s proposed regulations 
would have authorized agencies to adjust the 
method used to determine funds available to 

the agency's merit pay /pools to adapt for 

unusual distributions of performance ratings. 
Also, many employees in all three agencies ; 
believed and GAO found evidence at the depart- 
ments of Agriculture and Housing arid^Urban 
Development ( H^JD) that management used pre- 
esdbablished quotas to determine rating distri- 
butions for their merit pay pools in 1982 — a 
practice prohibited hy OPM regulations. (See 
pp. 7 to, 14 and 23 . j 

Although GAO did not determine whether each of 
the individual ratings was an accurate reflec- 
tion of the employee's performance, employees 
in field offices were more likely/to receive 
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lower ratings and lower ni^rit pay increases 
than headquarters employees who were in the 
saline pool Grade 15 employees ■ tended to re- 
ceive the highest ratings ^ followed by §rade 
14's arid, last, grade 13's. At HUD, Schedule 
C ( noncare^r ^PP^int??? ) employees were placed 
in merit pay pools with career employees , al- 
though OPM encouraged .afgenci^s to keep the two 
groups separate . These employees were more 
likely to receive higher ratings and larger 
average merit^ pay increases than career civil 
servants. This gave the appearance that these 
employees benefited from an unfair advantage 
w because of the political nature of Schedule C 
appointments. (See pp. 16, 17, 18, and 19.) 

^9? nc i? s ' formulas for distributing merit pay 
increases varied widely g,nd resulted dif- 
fering increases for employees receiving simi- 
lar performance ratings • For example, all ; 
three agencies imposed different maximum lim- 
its on the amount of merit pay that could be 
awarded. (See p>p. 19 and 20.) 



PERFORMANCE, STANDARDS 



eSRA requires agencies to establish perform- 
ance standards which, id the maximum extent 
feasible, use objective criteria , to accurately 
measure performance . GAO 1 s reviey showed that 
overall , performance standards in the three 
agericies improved slightly during the 2 years . 
For instance, in each agency, the percent of 
standards GAO reviewed _that _cd\ntained-__d^^ec- 
tive measures of performance increased from 
1981 to 198 2^ However , overall ; _ less than 
half the standards contained such objective 
measures. About 70 percent or more of the em- 
ployees ir> each agency responding to pAO 1 s 
questionnaires believed their standards were 
fai_r> tailored fto their. job* arid consistent 
with organizational goals in both 1981 and 
1982. (See pp. 25 to 28. ) 



OPM encourages agencies to allow all_employees 
to be involved in setting their performance 
standards . Most employees at Agriculture ? and 
Navy ~~( 70 and 76 percent , respectively) said 
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they were involved in setting their _ per fbrm- 
ance standards, while only about half in HUD 
(46 percent) believed this /to be the case.. . 
When asked to .what ext/ent they were satisfied 
with. their iqpirt in setting their standards, 
SI*. 52i and 29 percerit in Agriculture, Navy , 
and HUD, respectively, said they were satis- 
fied to a great : or verjL #r>at extent . (See 
p-. 31 . ) CSRA* require^ "Hfiat* pferforraance stand 
ards be communicated %o the employee at the 
beginning of each appraisal period. At HUD 
and Agriculture, this requirement was hot 
always met. Of the performance standards GAO 
reviewed that contained , the date they "'were 
communicated to the employee, 42 percent at 
HUD and 14 percent at Agriculture were deliv- 
ered t© the 'employee more than 6 months after 
the beginning of the appraisal period. (See 
pp. 32 arid 33 . j 

About 75 percent of the merit pay pool offi- 
cials GAO interviewed believed the standards- 
settino process was improving communications 
between* subordinates arid supervisors^ while 9 
10, and 17 percent of employees at HUD, Agri- 
culture, ajid Navy, Respectively, believed thi 
to-be true. (See pp. 29 to 34. ) 

OPM'S EVAIlUATIONS AND : 



Th^ CSRA requires that OPM analyze the cost 
and effectiveness of the merit pay system, and 
cash award program and annually ptiblish. the 
results. OPM evaluations of merit pay have 
been limited in scope and h&ve^_ not met this 
CSRA requirement.. OPM has published Several 
reports or pamphlets on merit pay arid also 
contracted with three universities to sturdy 
it, but these reports did not coyer the cost 
or effectiveness of merit payt The bj|M re- 
ports were primarily statistical analyses of 
payouts and ratings and descriptions of the 
various types of rSerit pay systems in effect. 
The university-contracted studies dealtwith 
how merit pay was implemented in several in- 
stallations. None of th^se studies reported 
oh the costs of implement at ing and operating 
merit pay nor did they report on the effec- 
tiveness^ of the merit pay system government- 
wide as intended by the GSRA. - (See pp. 37 to 
40.) * 
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OPM increased its emphasis on evaluation of 
merit pay in 1983 and has two major studies V; 
underway, one 6f\ which will address the impact 
of ijierit pay on employee performance and pioti- 
vation. _The three agencies GAO reviewed have, 
evaluated, their merit pay systems and* made 
several changes. \For instance, Agriculture 
changed its merit pay formula in 1982 to pro- 
vide greater reward s for its top-rated employ- 
ees. (See pp. 37 to 39,' 41, and 44.) 

CSRA required Agencies to establish a cash 
awards program to be used as an Integral part 
of the merit pay system. The agencies GAO re- 
viewed placed dif f erfent^degrees of emphasis on ^ 

their cash awards programs irv 1981 and 1982. 
For instance, in 1982, Navy- granted cash 
awards averaging about $1, 100 ( to about 30 per- ' 
cent of its merit pay \ employees . In contrast, 
in 1982, Agriculture dranted cash awards 
averaging about $1, OOOl to 6 percent of the 
' merit p^y. employees, while HUD gave awards 
averaging about $500 tip 6 percent. OPM has - 
recognized that it needs to provide specific : 
guidance : to agencies oft the distribution and ' *• , - - 
amounts of cash awards.] (See pp. 42 to 44 and 
app. XIII.) : 4 

According to OPM, a keyf factor in the eventual 
success of the me^it pa^ system is how well it 
is accepted and judged-^ employees par- 

ticipating in it^ After/; completing two ap- 
praisal and pay cycles, /employees' overall 
attitudes toward merit gay remain negative. 
However, there were improvements in employees 1 
perceptions of_ certain aspects of ^he system 
after the October 1982 merit payout's . For ex- 
ample, the percentage of employees who 
believed their merit pay increases weire an ac- 
curate-reflection of thpir performance. in- 
creased from 8 to 25 percent in Agriculture, 
from 10 to 216 percent in HUD, and from 15 to 
27 percent In Navy from 198L to 1982. How- 
ei/er, about 80 percent of ail employees in the 
three agencies do not believe the system in- 
creased their motivation or performance. ; 
Among the top performers, 75, 62, and 61 per- 
cent of the employees in Agriculture, Navy, 

arid HUD, respectively^ shared this view. 5 (See ^ \- 
pp. 48, 49, and 50 arid app. LV.) % " ci; h 
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CONCLUS IONS _ AND ; 

RECO MMENDAT I ONS" * 

GAO recognizes that certain practical .problems 
with the merit pay system, such as inconsis- 
tent raters, probably cannot be completely 
resolved , nor can the influence of nonperform- 
ance factors on pay be totally eliminated. 
GAO. also realizes that merit pay is still. a 
relatively new system, arid that compensation 
experts have stated that it may take 5 to 10 
years for a merit pay system to operate as in- 
tended . However , by taking steps now to 
ensure greater equity, in ratings and pay, and 
to reduce the_ef_fect of non-gerf ormanc6 fac- 
tors on pay, OPM is more likely to gain voider 
employee support and acceptance. This will in 
turn improve merit pay's chances of success. 
* OPM* s regulations , that were scheduled, to go 
intp effect^Noveipber 25, 1983^Would have ad- 
dressed some of GAd ' s recommendations . 

These regulations , which also covered, several 
personnel subjects other than merit pay, have 
been declared null and void by the U.S. pisr 
trict -Court, and OPM has been en joined from__ 
directly ot indirect iy implementing them. The 
court decision does not preclude OPM from 
sponsoring legislation or drafting new regula- 
tions to address the issues discussed in this 
report, and GAO believes several changes need 
to be made Eb*the merit pay system . There- 
fore, GAd recommends that, to the extent that 
it is legally permissible, 'the Director, Of- 
fice of Personnel Management, 

— assess the impact of pooj composition and. 
agency formulas on merit * pay increases and 
develop criteria that will reduce the effect 
of nonperformance factors on merit pay in- 
creases ( see p . 23 T; 

— reemphasize the need for agencies to estab- 
lish separate merit pay pools for their 
career and noncareer (Schedule t) merit pay 
employees to avoid the appearance of their 
having^an unfaifr advantage in competing for 
merit py increases Jsee p. 23); 

t • 
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— enforce the regulations which prohibit. 

forced distribution of ratings (quotas) (see 

23 j; "■ J* 

— require that merit pay pool managers or 

their delegates review performance standards 
at the beginning of the appraisal period to 
ensure that, to the maximum extent feasible, 
they contain the desired characteristics of 
objectivity and measurability and that they 
aire of comparable diff icuity for similar 
jobs ( see p . 36 ) ; 

--require that employees be given the oppor- 
. t unity to consult with their supervisors in 
setting their performance .standards (see p. 
36); -1 

— require that standards be conununtcgted to 
employees within a reasonable and specified 
time from the beginning of the appraisal 
period, ( see p . 36 ) ; 

— provide adequate resources to maintain its 

planned merit pay evaluation tef forts { see 
n p. 47); 

— clarify the ijntended role of the cash award 
program for merit pay employees and provide 
■ guidance and oversight that will fensure that 
" 1 it is used aa an integral part of merit pay 
(see p. 47); and 

•V _ " . " _ _ - __ 

^\ — comply with the legal requirement to publish 
annual reports which analyze the cost and 
effectiveness of the merit pay system and 
cash award program (see p. 47). 

ftGENCY COMMENTS 

GAO received written comments on the draft of 
this report from the Departments of Defense 
V_ and Agriculture and the Office of Personnel 
Management. GAO received oral comments from. 
HUD. These agencies generally agreed with the 
report's findings arid recommendations ♦ OPM 
stated that it does riot believe it necessary 
to report on the costs of the merit pay system 
because the total payouts under merit pay are 
the same a& they would have been under the 
General Schedule. However, the law requires 
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that OPM publish a report bh, the cost and ef- 
fectiveness of the merit pay system and OPM 
has not kept track of the costs incurred in 
implementing and operating this program. (See 

p. 47'. r 

Agriculture commented that although techni- 
cally correct, appendix VIII creates a false 
impression that unfair benefits are ^accruing 
to higher graded employees. Appendix VIII 
shows the average actual increases received by 
merit pay employees in each grade and. is .de- 
signed to demonstrate- the magnitude of the in- 
creases. The charts were not intended to 
imply that higher graded employees^unf airly 
received more than lower graded employees . 
The complete text of all the agencies' written 
comments is contained in appendixes XI through 
XIII. 
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Acceleration factor 



Annual salary adjustment 



GLOSSARY j 

a" mathematical factor used iny, sbnie 
agency pay formulas to provide the 
largest merit pay increases to employ^ 
ees lower in the salary range. A Award^ 
ing more money to those lower in the 
r§nge allows them to catch up with 
similarly rated employees higher in 
the range. J ^ 

The average annual percentage increase 
usually given each "October to adjust, 
federal salaries in the General Sched- 
ule. It is an adjustment to salaries 
to reflect those currently existing in 
the private sector for similar work 
and levels. A 
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Automatic increase 



The guaranteed portion of e merit pay 
employee's total annual increase^ It 
can be 50^ percent (or more if OPM so 
decicjp-s ) of the annual salary ad j ust- 
merft granted to General Schedule 
employees . — i 



Cash award 



Critical element 



Fbt a merit pay employee, an ^ward , 
not to be included as part of base 
salary, given for superior accom- 
pli shment L _ an invention , suggestion^ 
special aqt or service, or ojjher per- 
sonal effort which contributes to the 
efficiency, economy, or other improve- 
ment of the government. Gash awards _ 
may riot exceed '$10,000 unless approved 
by OPM. ^ 

A component of an employee ' s job that 
is of sufficient importance that per- 
formance below the minimum standards 
requires remedial act ion and denial of 
a _ m ??it pay l ricr ? a ?? • Unacceptable 
performance may also be the basis for 
removing or reducing the grade of an 
employee. Such action may be taken 
without regard to performance on other 
job components . 



l 



Forced distribution 



Grade adjustment factor 



GM 



Merit pay fund 



Merit pay. increase 



Merit pay p>ool 



Merit pay pool official 



The result of a management decision 
designed to' achieve a predetermined -» 
distribution of individual per forrti- 
arice- ratings. OPM has stated that ? 
"no merit pay determination may^ be _ 
modified in order to force a specific 
distrlbuti6n_of performance leve'l^, 
*among^ merit pay employees." » 

A math^ssmtical factor_that maintains 
the iStergrade pay differential , that 
is, the percentage salary difference 
representing the differences in dif- 
ficulty arid complexity among merit 
pay grade levels . 

A pay system designator used to indi- 
cate, that a position is covered by 
the provisions of the merit pay 
system. 



The amount of money available to an 
agency head < for the purpose of grant- 
ing merit pay increases, 



The merit 



pay fund includes the nonautomatic 
portion of the comparability adjust- 
ment and amounts estimated to reflect 
within-grade and quality step in-; 
creases that would have been avail- 
able to merit pay employees under the 
General Schedule pay system. 

The amount of money added to an em- 
ployee ' s total annual base salary 

that recognizes and rewards perform- 
ance based on periodic appraisals of 
performance • 

Those grouped employees who compete 
directly for fixed merit pay funds . 

Merit pay pool managers or their rep- 
resentatives interviewed during this 
assignment. 



Performance appraisal 
• or rating 



A descriptive account which measures 
employe* performance during an ap- 
praisal \period . Under mer>t £>ay , - 
ratings are to be based on the em- 
ployee ■ s performance measured against 
established criteria . 
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Performance element, 
or element - ^ 

Performance salary 
ceiling * ; 



Performance standards 



/ A duty or responsibility for which an 
employee is accountable. 

A ^^chnique used in some merit pay 
plans to set a limit or limits in the 
salary range beyond which the employee 
ro^Y 09^ a dvance unless his/her per- 
formance improves; 



{ 



A description of how well an employee 
must perform specific tasks . " These 
standards enable employees. and super- 
visors to determine how well the em- 
ployees are dqin§ their work by 
comparing their actual performance to 
the^a t an^ard s . When feasible, per- 
form^nce^an^ards should I contain 
meaaurfefi^T quality, quantity, and 
timel iness ; 



Presumptive rating 



Rating, assigned when an employee has 
hot been in a merit pay position or 
under performance standards for a req- 
uisite period of time arid when the 
quality of the performance cannot be 
measured because there is insufficient 
information to make a meaningful 
assessment . 



Quality step increase 

' r 



Top performers 



An increase in an employees basic pay 
rate that is designed to recognize 
sustained high qual ity performance . 
Merit pay employees are riot eligible 
for quality step increased. However* 
the merit pay fund includes the total 
amount of those increases pool mem- 
bers Would have received if they^rem- 
ained -under the General Schedule . 4 

Those employees who in Agriculture , 
were rated at 4.5 or higher (but of 
5.0) ; in UUD, a were rated Outstanding ; 
or in Navy, wereb rated at Level 1 
(highest rating ) . 



Wi thin-grade increase 



^'periodic increase given to General 
Schedule, employees as a permanent 
increase to base salary. General 

> ; Schedule employees receive about a 
3-perceht Increase provided ttyeir 
performance is acceptable. Merit pay 
employees are not el ig ibie for 
wi thin-grade increases, but the amount 
they would have received for such ^ 

- increases is included in the fixed 
merit pay fund. 



T 
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CHAPTER 1 /\ ; 

^ - INTRODUCTION 

The merit pay system and cash award .program was crested by 
the Civil Service Reform Act (CSRA) of 1978, ^ahd has been in 
effect sincte October 1981 . The Chairwoman, Subcommittee on Com- 
pensation arid Employee Benefits, House Committee bri Post Qffide 
arid Civil Service, asked us to review agency experiences ih mak- 
ing the transition £o merit pay. In response to this request, 
we reviewed the implementation and operation of the merit pay 
systems during the 19.6l and 1982 pay cycles at three Depart- 
ments : Agriculture, * Housing and Urban Development (HUD), and • 
Navy. These Departments combined exnploy about 25 percent c^f.all 
federal merit pay employees. ^ 

OBJECTIVE OF CSRA; TO LINK ' • 
MERIT PAY TO FAIR AND OBJECTIVE 
PERFORMANCE EVALUATION > 

The objectives of the merit pay system, as expressed in the 
CSRA, Sre to: 



— Recognize and reward quality performance by varying merit 
pay increases using available funds . *~ """"" 



— Use performance appraisals as the basis for determining 
merit pay adjustments. 

— Provide for training that will help supervisors improve 
their objectivity ^nd fairness in evaluating performance, 
again using available funds. 

The _merit pay system was llso intended to (1 ) significantly 
improve productivity, ideas, and service to the public and 
(2) increase cor^unication between supervisors and subordi- 
nates. The performance appraisal provisions, specifically, were 
expected to help supervisors accurately evaluate job performance 
based on objective criteria. 

Upon sighing the CSRA, f c^Ler President Carter expressed 
hope that merit pay would put _ 



" . . . incentive and reward back into the Federal ^sys- 
tem . . . From now on, projnotions and pay increases 
will be a sign of jobs well done." 



X Title V, Public\Law 95-454 , _October 13, 1978, 92 . Stat. 1179, 
now codified at 5 U.S.C. §^5401-5405 (1982). 
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'AdditJlbriaiiyi the first Director of the Office of Personnel Man- 
agement (OPM) indicated that the performance appraisal process 
would be • . ; - ' * 

... ■ - . j ; 

"; i . to the direct benefit of the vast majority of 

Federal worker si who do their jobs well and want, to be 

jS^??^. 011 -^? _kasis Pf_ t ^ ie ^ r P e ?*^ orinari 9 e • T he ' in- 
creased emphasis on meaningful appraisals -will impose 
additional responsibilities on managers , 15*ut it will 
also provide them with a more effective and equitable 
means of managing their employees." * 

He further remarked that "unless the Civil Service Reform Act 
improves governmental performance , it will riot have succeeded • " 



MERIT PAY INCREASES ARE- 
BASED ON PERFORMANCE RATINGS 

Merit p$y f undameritaily changed the way some employees 1 
saLaries are determined . At present, most merit pay employees 
have been through only two complete performance appraisal and. 
payout cycles. As wbuld be lli^ case with any new system* prob- 
lems have occurred which must bd resolved for the system to • 
achieve its intended goals. Compensation experts have stated 
that it may take from 5 to 10 years for such a system to operate 
as intended. ^. . 

_.<=-., ' 

Under the merit pay system, pay increases^ for supervisors 
and management officials in girades 13 throughl5 N are based on. 
performance. Merit 'pay employees are placed iSvO^rganizatiohal 
groups (merit pay pools) whose composition is determined by ^ 
agency management. These employees do riot automatically receive 
annual salary adjustments, usually granted to General Schedule 
employees, nor are they eligible for, wi thin-grade arid quality- 
step increases that general Schedule employees may receive. - 
They are guaranteed at least half of the annual salary adjust- 
ment and compete against each other for additional met it pay 
increases which are based 9 n _the degree £o which the employees 
me^^Dr exceeded performance standards .established at the begin- 
ning of ' the appraisal petibd . These increases are paid out of a 
fixed merit pay fund .which is made up of a maximum of one-half 
the annual salary adjustment pl*us an amount equal to the 
within- grade and quality-step increases pool members would h|ve 
received had they remained under the General Schedule . Accord- 
ing to OPM, about 108,000 employees were covered by the merit 
pay system in fiscal year 1982; '(About 80,000 GS-13's through ;' 
GS-15*s Were ndt designated as ^managers or supervisors.). 



OPM is responsible for developing procedures for implement- 
ing arid operating merit pay systems governmentwide . It is 
responsible for providing technical assistance to agencies, re- 
viewing and approving merit £>ay plans, issuing guidance on which 

s \ 9 ' 

. * ^ J . 
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posit ions ^W^Uld be covered under merit pay, and evaluating the 
cost arid^iff ectiveriess Sf the merit pay system and cash award 
program. In October 1983, OPM> .proposed regulations which would 
alter the scope of - the merit pay systems and ^ which it stated, 
would address some of our recommendations contained in chapters 
2, 3, and 4; However, on December 31, 1983, t\\e regulations 
were determined to be nul-1 and void by the U.S. District Court* 
arid OPM^was enjoined from directly or indirectly implementing 

them.V 5 

OBJECTIVES, SCOPE, AND METHODOLOGY ♦ • ; * : 

Our . objectives for this review were to determine how three 
large federal agencies implemented mferit *pay systems arid made 
their pay increases for fiscal years 1981 and 1982 and how their 
systems have operated since then. We also wanted to (i) observe 
how the agencies evaluated merit pay implementation^ (2) deter- 
mine how merit pay was perceived and acjepted by employees and 
managers, and (3) identify areas requiring attention . With the 
concurrence of the requesting Subcommittee ^ we decided that a 
2-year study, with data collected after the October 1981 and 
October 1982 merit pay cycles, would meet these objectives arid 
also allow us to evaluate how the merit pay system had, evolved. 



We selected the Departments of Agriculture , HUD, and Navy, 
because they employ large numbers of merit pay employees, repre- 
sent both military and civilian agencies, and have different 
types of merit pay systems. Agriculture had about 9, 600 merit 
pay employees in 1981 and 1982, HUD had about 2,200, arid Navy 
had about 16,100/ Combined , these Departments employed about \ 
28, 000 employees under merit pay systems — 25 percent of all fed- 
eral merit pay employees. 

To find out how merit pay was . implemented , we interviewed 
merit pay pooi officials 2 and reviewed performance appraisal 
arid pay * statistics of/pools in each of the Departments . Because 
merit pay pools in all three Departments* were scattered across 
the country, it was not feasible to interview a statistically 
valid random sample of pool officials that would be protectable 
to each Department. Therefore we judgmental ly selected merit 
pay pools from each Department . To get some indication of how 
the systems were progressing, we reviewed essentially the same 
pools and interviewed the same pool officials when possible dur- 
ing both years. More details on the number of pools reviewed, 
the number of pools in each agency, and the number of employees 
included iri the pools we , reviewed are included in appenaix V, 



-Pool managers or their representatives . 

• / 

• 3 4 
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We also reviewed a randomly chosen sample of performance 
-ratings from these pools and analyzed them to determine whether 
they complied with requirements of the CSRft. We analyzed the [ 
1981 and^!982 performance ratings of 475 employees U_total of ^ 
950 ratings), which included dVer 12,000 separate performance 
standards, and evaluated the quality of the standards.- To do 
this * we analyzed each standard to determine if it Contained 
measures of quality, quantity, or timeliness . Sample sizes for 
this -analysis were sufficiently large so that we are 95-percent 

confident that the reported results are within 5 percentage : 

points of what would' have been found if we had reviewed ail the 
ratings in these pools . A detailed discussion of the methodol- 
ogy followed in analyzing the performance ratings is included in 
appendix VI. \^For both years, we also analyzed summary statis- 
tics on ratings and pay increases from the pools reviewed as 
well "as overall statistics provided by the ^gericief . • 

Finally, we administered a questionnaire to merit pay em- 
ployees in the three agencies to determine their attitudes and 
opinions on various aspects of merit\ pay over the 2 yfears • : At 

tVfe time of our firs^ survey, H^P_? n ^_^9?'i c 5 l i^ a ?? wc *" e .^^?®?!9P"" 
ing questionnaires of their own and agreed to attach pojr ques- 
tionnaire to theirs. These were > mailed to all HUD arid* 
Agricultqre merit pay employees and were returned by 62 percent 
in HUE) and 60 percent irt Agriculture. 

Since the Navy had not developed a questionnaire at the time 

of our first survey, we sent our questionnaire directly to a 

random sample of 624 NaVy merit pay employees and had a response 
rate of 94 percent*. We also received 97 unsolicited Completed 
questionnaires from Navy merit pay employees not in our sample 
who wished to contribute their opin-ions to our study. These y 
responses were not included' in an^f* ©f the statistics presented 
in this report- Final sample sizes for the first survey in the 
Departments were large enough tha^ we are .95-percent confident 
that findings are within- 4 percentage points or less of what 
would be found if all mef it pay employees in the three Depart- 
ments had been sampled . : - * 

For the second year, we used the same questions, but added 
other questions bafed oft the results of the first year. ^ This 
facilitated £ comparison' of first- and second-year attitudes and 
opinions . s 

Since none of the three Departments was using a question- 
naire to evaluate Employee attitudes about tha second year of 
merit pay', in January 1983 we sent questionnaires to a random 
sample in each Department.' We sent 580 Questionnaires to Navy 

r ; , ■ 
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merit pay employees, : 643 to HUD employees, and 586 to ftgricul- 
turte employees. Response rates were 90, 90, and 89 percent in 
tKe three Departments^ respectively . Sample sizes were large 
enough so that we are^5-percerit confident that findings aire 
\yithih 5 percentage points or less of what would have been found 
if all jraerit pay employees. in the Departments had been sampled. 
Confidence intervals* sampling errors* and questionnaire results 
for both years' surveys are included in appendixes II arid Illi 
. V*?--. 

We a 1 s'Qf, separated Qu t and analyzed the responses of top 
per formers-- those employees in our surveys in 1982 who were 
rated in the tgp performance category tey their agency . The - 
*P?^pose v*as _tq f ind out how' the attitudes of those who had 
received the best ratings and largest merit increases differed 
from the rest of our sample population. 

Because our work in both years covered drily 3 of approxi- 
mately 70 federal agencies with merit pay systems , we cannot*'' 
pro ject/our f iridirigs to all agencies or merit pay employees— 
only to those examined. However, because Agriculture,, HUD, arid 
the Navy experienced similar merit pay problems in both years 
and employ about 25 percent of all federal merit pay employees, \ 
we believe Our findings are a valid basis for making recommenda- 
tions to OPM por improving ther- merit- pay system. 

__"»_ r ___ s 

We conducted the review at the three Departments' headquar- 
ters in Washington, D.C. , and at merit pay pools from each De- 
partment in the Boston and Sari Francittb areas . Audit work 
begarv in December 1981 arid ended, in March 1983. The review was 
carried out according to generally accepted government auditing 
standards • 
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FACTORS OTHER TH 




AFFECT MERIT PAY 



1 The Human Side of Enterprise^ Douglas McGregor, 1960, p. 82. 
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, The CSRA requires agencies to establish merit pay systems 

which shall "usq, performance .appraisals as the basis for deter- 
mining merit pay ad j ustments." Howeyer r several factors inde- 
pendent ojf performance affected the .lize of merit pay increases 
at ;Agrvr*5uIture , HUD, and Navy*. These" included the accuracy and 
consistency _bf the performance standards ahdf ratings; _%he dis- 
tribution of ratings in the pool; the formulas the Departments 
used to distribute'mer it pay; arid the variable annual salary ad- 
justment up to half of which carj be used as merit pay. Some of 
these factors, a»uch as the amount! of money available for merit 
pa'y, increases,^ cannot be controlled by the agencies. Other fac- 
tors , such as the merit pay formulas, can be controlled by agen- 
cies . While these factors which cause' differences in merit pay 
are not prohibi ted by' law and _ may ^ never be completely el imi- 
natec? , they have contributed to rtegative employee perceptions of 
merit pay. •» : . 

STANDARDS AND- RATINGS MAY BE INCONCLUSIVE 
MEASURES OF PERFORMANCE \ 

Some performance standards and ratings may not accurately 

measure per formance and can hay£ an impact on the employee's 
merit pay increases. According to one recognized performance 
appraisal expert, 

" .1* . the problem of variation in the standards of 
different j udges has never been completely solved , 
ndr have we succeeded in eliminating the effects pf * 
. bias and pre j udice in making appraisal j udgments . M 1 v ; > tV 

Recognizing\tfhat standards and appraisals prepared, by di f- j 
ferent superyisoB^ may not be consistent , some managers in the. 1 
three agencies reviewed employee standards and appraisals before' 
they were finally approved. Despite the reviews for consistency 
that may have taken place in these and bther pools, between 3/7 
and 52 percent of the respondents in both years in each agency j 
believed, their 1981 and 1982 ratings did not accurately reflect j 
their performance . In addition, over 40 .percent of the merit [ 
pay employees surveyed in 1982 believed that inconsistencies in 
how raters judge performance was a great of very great problem . . 
in their pool. Employee comments regarding inconsistent ratings • 
included: 
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— "I do know from others attd from my own performance rating 
that a great variation in ratings occurs. The system has 
to be standardized to be fair." 

--"Probably the greyest difficulty? and the source of the _ 
most skepticism. $|£ the improbability of the various f 
supervisory rat ing^ori ah equitable basis • • . ." .j r^> 

— "ThJ^dif ferent departments in outrun it fate by subjective 
standards. Some departments are very conservative and , 

^others are very i iberal ; 11 .-. ■ * * 

Some merit pay Officials and employees believed that per- 
formance in their job could not be accurately measured through 
standards. Or>e employee said, "It is difficult, if not impossi- 
ble, to rate scientists fairly across different disciplines. " 
Another said, "As a technical man doing highly varied work, my 
productivity and quantity of work are no%] subject to easy and 
concise definition." Still another said^ "when brain power is 
used to do Research and answer policy issues, performance ele- 
ments are difficult to develop &r\d evaluate ; rt Most pool offi- 
cials said there were no standard measures that would allow them 
to accurately assess employees' productivity. c / 

DISTRIBUTION OF RATINGS INFLUENCES MERIT PAY 

The distribution of ratings within a merit pay pool is cru- 
: cial'iri determining the merit pay increase each employee re- 
ceives;. As a result, employees * in pools with very different 
ratings distributions can receive significantly different merit 
pay increases even if they received a comparable rating. OPM's 
proposed 1983 regulations would have reduced to some extent the 
impact of the rating distribution by allowing agencies to adjust 
the methods they use to determine funds available to the pool to 
adapt for unusual distributions of ratings. 

Appendixes VII and VIII show the agencywide distribution of 
ratings and the average merit pay increases by grade level and 
-^rating at the three agencies. 

In each Department, the distribution of ratings in pools 
varied Widely in both years. For example, in some pools, oyer 
90 percent of the ratings were in the top two levels (for in- 
stance, outstanding and highly satisfactory), compared to less 
than 20 percent in other .pools* When many people within the 
pool are highly rated\ top performers receive less money than tf 
most of the pool members were rated: at a lower level, such as 
fully satisfactory. This^ is true even in a controlled situation 
in Vhich- pools are identical in makeup and have an .equal amount 
of funds available f<or merit pay. Examples of differences in 
pay for comparable ratings in different pools at the three 

«■ 7 " 
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Departments are shown below; in ail cases, 1982 merit pay ^ 
increases were much larger than in 1581. This was because merit 
pay funds in 1982 included half of the comparability adjustment 
plus 1 .6 percent of salaries for wi thin-grade pay increases. 
Because of a GAO decision qpm had reduced the within-grade 
contribution from 1.6 to .8 percent of salaries for the 1 981 
payouts. (For each year, two separate pools are shown. Thus, 
pool 1 In 1981 is not the same as pool 1 in 1982.) 



Effect of Rating Distribution oh 
Average Mer it Increases in Four Agriculture Pools 

1981 

Pool 1 Pool 2 

Merit Merit 

Ratings increase Ratings increase 

Performance in forj3M-14^s in for GM-14^sb 

category 3 category in category category in category 

( percent ) ( percent ) 

4.5 to 5.0 53 $383 7 $658 

4.0 to 4.4 43 342 12 598 

3.5 to 3.9 2 315 37 541 

3.0 to 3,4 2 134 44 464 

Below 3.0 0 - 0 

*■ 

* - 

Pool 1 \ Pool 2 



4.5 to 5.0 30 $1,955 5 $2,364 

4.0 to 4.4 45 . 1,7S4 49 1,894 

3.5 to 3.9 22 1 ,638 32 1,446 

3.0 to 3.4 3 1 ,266 14 578 

Below 3.0 0 - 0 - 

A 

^Agriculture uses adjective descriptions for each performance 
level, with each adjective corresponding to a number, as fol- 
lows: 5.0, Outstanding; 4.0, Exceeds Acceptable; 3;0, Accept- 
able; 2.0, Minimally Acceptable; and below 2.0* Unacceptable. 
The composite ratings, such as 4 . 5 -, represent the weighted av- 
erage of the rating score assigned to each performance element, 

bin pool 2, in 1 98 1 , more money was available per person for 
merit pay because pf higher grades and salaries of the pool 
members, a factor which also affected the difference in final 
merit pay increases. 



2 Q££tce of Personnel Management's Implementation of Merit Pay , 
B-203022, September 8* 1981. 
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Tabled 2 

Effect of Rating Distribution on ; 
Average Merit Increases in Four HUD Pools * 

Pool 1 Pool X 



^ Merit Merit 

Ratings increase Ratings increase 

Perfprmance in for GM-14's in for GM-14's 

category category in category category in category 

^percent) (percent) 

Outstanding / 0 $ ^ - 11 $ 956 

Highly satis- „ \^ 

factory 23 1,797 74 477 

Fully satis- 

f actorya - 68 - 13 - 

Marginal/Un- _ : 

satisfactory J 5 - . 0 - 

Presumptive 

Fully Satis- ^\ . 

factory 15 3 - 2 

_ 1982 _ _ 

Pool 1 Pool 2 



Outstanding 18 $3,034 4 $4,252 

Highly satis- • ^ 

factory 53 1,913 ' 44 2,561 

Fully satis- 
factory 20 823 47 1,103 

Marginal/Un- 
satisfactory 0 - 1 - 

Presumptive 
fully satis- 
factory 8 489 5 884 

^HUD did not award merit pay increases to Fully Satisfactory em- 
ployees in 1981. - 

b A rating of Presumptive Fully Satisfactory is given when the em- 
ployee is not under standards approved by the pool manager long 
enough to be given a rating based on his/her actual performance. 
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Table 3 ■ 

Effect O f Rating "Distrib ution on 
Avera gV Merit. Increases J:n frotar Navy Pools 
. 1981 



Pool 1 



Pool 2 



Performance 
category 



Level 1 : 
Substantially 

exceeded all 

objectives 

Level 2: 

Substantially 
above target — 
most signifi- 
cant objectives 



Ratings 
in 

category 
(percent ) 



40 



Merit 
.increase 
for GM-14's 
in category 



.25 



$838 



419 



Ratings 

in 

categor y 

(percent j 



Merit 
increase 
for GM-14 f s 
in category 



$1,374 



41 



687 



Level 3: 

Above target — 
most signif i- 
cant objectives 

Level 4: a 

On target — all 

significant 

objectives 

Level 5 : 
On target — some 
objectives 



18 



17 



140 



45 



229 



Level 6: 

Below target— -bne_ 
or more critical 
elements 



a Xn 1981 , Navy did not award merit pay to Level 4 performers, 
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Pool 1 



Performance 
category 



L^yel 1 : 

Substantially m 
exceeded ail 
objectives 



Merit 
Ratings increase 
in for GM-I^'s 

category in category 

(percent } 



36 



$2, 129 



1982 

Pool -2-- 

1 '. Merit 

Ratings Increase 

in for GM-14 's 

category in category 

(percent) 



16*„ $2,759 



Level 2: 

Substantially 
above target— 
most signifi- 
cant objectives 

Level 3: 

Above target- 
most signifi- 
cant objectives 

Level 4 : 

Qri target — all 

significant 

objectives 



55 



1 , 725 



1 , 313 



25 



45 



20 



2,236 



1*702 



1,312 



Level 5: 
,On target — some 

objectives 0 0 

Level 6: 

Below target— brie 
or more critical 

elements 0 - 0 

As shown in the tables, significantly different merit pay in- 
creases were given to equally graded and rated employees who 
happened t6 be in different pools. For example,, in 1982 at HUB, 
an Outstanding GM-14 employee in Pool 2 received over $1,280 
more than a counterpart in Pool 1. At HUD in 1981, a Highly 
Satisfactory GM-14 in Pool 1 received almost twice as large ah 
increase as an Outstanding employee in Pool 2. 
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RATING QUOTAS WERE USED 

IN SOME INS TANCES • — ^ ^ 

regulations prohibit ^Hcing rating distr ibutions to 
fit Quotas. The effect of this^Fas stated in a 1979 OPM 
pamphlet , 

"To allow artificial arid arbitrary ribrirperf ormance 
factors to drive the merit pay increase would ... do 
irreparable harm to the Merit Pay System. "3 

Agency documents arid *discussidfis with^p&^l officials and employ- 
ees lead us to believe that some merit pay "reviewing of f icials 
forced distributions of ratings to meet rating quotas by lower- 
ing ratings prepared by immediate supervisors. In one instanae^. 
at HUD, a division director issued a memo stating, in part, 
that: 

"For [the office] , the distribution is expecteS to be 
roughly: 1 0-15% Outstanding; 25-30% Highly Satisfac- 
tory; 40-60% Fully Satisfactory; and 5-10% Unsatisfac- 
tory .... No individual division is expected to 
deviate more than two or three * percentage points from 
these ranges."", 



After this memo had been written, the HUD Assistant Secretary 
responsible for the division wrote his executive assistant, "I 
want us to aim for no more than 10% [to be rated] outstanding 
- . . ." Actual final ratings in the division^ were 13 percent 
Outstanding, 39 percent Highly Satisf actbry^42 percent Fully 
Satisfactory, arid 5 percent Marginally Satisfactory . _The Assis- 
tant Secretary, in a separate memo, later required a Deputy _ ; . 
Assistant Secretary to downgrade some ratings front Highly Satis- 
factory to Fully Satisfactory, in order to " . . .Restore a 
pcoper balance with the general pattern in [the office] . " HUD 
officials told us. that this may have been ^legitimate attempt 
by management to ensure consistency of ratings . 

Other examples of alleged forced distribution of ratings 
included the following: 

— A HUD division director told us of being directed by\ 
higher management to lower any three subordinates 9 \ 
ratings. ^ 



.-A memo to the staff of an Agriculture regional official 
, stated t^hat they should 



3 Your Merit Pay System , OPM, November 1979, p. 26 . 
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carefully .review performance ratings in 
•Voor?|a?* : . |fe»* : -f»a. perhaps go back to your pay 
pool supervisors 'if 1 the average for the pool 
f al 1 s -btf ts-ide the range" 3.7 -4.1 and 1 the 
standard, deviation is ' not at least 0.30. 

—Another HUD memo stated that "any manager who anticipates 
J distribution deviating widely from [an attacted dis- 
tribution] can expect to be tasked to reconsider the dis- 
tribution . _ ; \ •• • ; v 

Agriculture memo, a rating of ficial' complained, that 



ii 



it is Verj| obvious _ttiat the changes " 
rvour'office made to rating I- submitted on my 
subordinates] were strictly based oh the' num- 
bers game' and not on performance. .My apprSis- , ^ 
als [of them] were right and fully justified ... . 

based on [their] actual performance.- > 

Tn additionl 30, 59, and 43 percent of Agriculture HUD , 
and ^respondents^ 

quotas to .develop ratings" in their pool .in 1§82..^Betwee.o^n | na 
27 percent of the merit pay employees in the three De P^^ n " 
oelieved that changes to ratings made by higher level officials 
J 1 T re t or V erv great problem. Narrative responses from , 
merit pay employ!!! concerning alleged forced distribution .of ^ 
ratings follow: !"'';« : - '' 

--"There was definitely a' 'quota' system in my organiza- ^ 
tlon ^ sSpervisortold me outright that he^could give • ; ~S 
one fully and one highly satisfactory -rating . , ■ 

< -"I think our managers felt pressured to J° llb * h f ^|*|^ 
Distribution Curve to come up with ratings. This is ba*^, 
for an organization that has highly motivated people. *\ 

-"This vear Merit Pay has created a moral [e] problem. < 
Some of my associates had their ratings changed because , , , 

of a. quota system." 

"in an effort to be equitable the Agency actively pushed ,. . 
all ratings down, which seriously diminished some employ- 



ees' self esteem." 



-"Most employees perceive/that quota^are established de- 
spite the restrictions fn . . pre-established or forced 
distribution of levels of performance. 
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— "Quota systems were used in both years;. Such a system, 
definitely affects motivation. I was more or less told 
my performance Hid been outstanding but due to 'other 
considerations' I would have to be rated highly 
satisfactory, " 

Respondents who believed management used a quota system in 
developing ratings generally had negative feelirtgs toward the _ 
merit pay system. For example , when employees ^ho believed rat- 
ing distributions in their pool were forced in 1982 were com- 
pared .to those who did not believe distributions were fbrce<^, 

_^ ' i - ■ _ 

— fewer believed that the merit pa$r£perf brmahbe appragLsal 
system was fair; 

—fewer believed that the standards were set and ratings 
and payouts made without favoritism; 



--more believed that communication with their supervisors 
had gotten worse; and 

— fewer believed that merit pay was fairer in fiscal year 
1982 than in fiscal year 198 t . 

When a case of possible forced distribution is brought to 
its attention^ OPM refers the case to the agency involved and 
asks the agency to investigate and report back. 

dOHPOSlTION OF THE MERIT -PA¥ 
POOL INFLUEN CES PftY , ^ 

The composition of a merit pay pbbl--the number of employ- 
ees and their grades and location in the salary range — also af- 
fects individual merit pay. This is because the composition of 
the pool affects how much money is available to make up the fund 
as well as how much, of it each^ person will receive. Because the 
composition of *pqbii varies greatly, individual pay can also 
vary despite a similar rating . O^Mjias not prescribed how the 
membership of merit pay pools shoijjra be determined^ 



Extremes in poo]^ 

accentuate^ 

nonperformance factors on pay 



Small pbols^ of 10 or fewer people,, accentuate any differ- 
ences (in rating^ grade, or position in the salary range) among 
pool members. The President, who has the authority 4 to exclude 
agencies from the merit pay system, recognized the problems with 



*This authority is contained in the provisions of 5 U.S.C. 
S 5401 (b)(2)(A). > . • 
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small pools when he excluded several snail agen9ies in 1981 and 
1982; He noted that " 

11 ; ; with very small groups> another _ individual ' s 
performance has nearly as much impact on one's in- 
crease, as his or her own* and merit pay cannot be con- 
f iderttly administered . " 

Recdgnizing the effect of small pools on pay, managers may 
be tempteld to give all pool raembers the sanie rating . For 
example, at Agriculture, about 47 percent of all pools (166 of 
35 1 poolsj contained 10 or fewer people • In 24 percent (40) of 
the small pools , all members fell into the same rating category. 

* - , ^ - - p 

In large pools (those containing several supervisors and 

their staffs ) , ratings and , there-fore , pay may not be cons is- , 

tent . This is because some supervisors may rate harder than 

others , as d iscussed earlier. As a result, pool members vp* 1 * 1 

lenient supervisors may .benefit at the expense of their 

coworkers in the same popl whose raters are more strict. One 

employee commented that : 

"In a pool as large as the one I am in several super- 
visors rating high creates ah unfair distribution. 
\ . . . people in another staff were rated , by a 

[supervisor] without guts or a different set [of] 
values, higher than me and did not produce 'half of 
what I did." 

The grades and salaries of pool member s 
influence the- amo unts • of merit p ay 

The combination; of employees' grades and positions in the 
salary range affects the amount of money included in, and influ- 
ences th£~ individual merit ptoy increases made from, the, merit 
pay pool fund. OPM 1 s merit pay formula requires that different 
amounts be included in the pool fund for GM-13 ' s, -14's, and 
-1 5 1 s at different positions in the salary range. Therefore, - 
the total fund can vary depending on the number and combination 
of grades and salaries in the pool . 

In- addition, a grade adjustment factor is used to recognize 
the difference in complexity, importance , and difficulty of work 
at the GM-13, -14^ and -15 levels. This factor results in 
award ing the highest percentage of money from the fund to 
GM-I5 f s and the lowest to Sm~13's in proportion to the amount 
they contributed . 

Despite this grade adjustment factor, managers at Agricul- 
ture^ HUD, and Navy gave GM-15^s higher ratings than the GM-l3 f s 
and GMM4's in 1981 and 1982. (See app. VII.) Thus, GM-15's 
who were in a pool with many lower graded employees may have 
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received higher increases than GM-15 ' s competing primarily with 
other GM-15's. Dissatisfaction with this practice is expressed 
in the following comments: . 
• f * ** 

— "Supervisor believes GM-15's deserve higher performance * 
[ratings] than 14's and 14's higher than 13's. The 13's 
are supporting the merit pay system. for the 14's and 
15's. A separate pool should be made for each grade 
level." ; ; {/' 



— "Being a GS-13, and in a pay pool for GS-15's, -14's, 
-13's/ obviously puts me and other GS-13*s in ah 
unfavorable position I _ The bonuses and. higher ratings 
that_ gp_ to _GS- 1 5 ' s and 1 4 ' s real istical ly mean less $ 
available for the GS-1 3 ' s%-^T~think each grade should 
stand bri its ^t>wri III) with its qwri pay pool I " 

— "MPS [merit pay system] benefits higher management - 
GM-1 4^* s and 1 5 1 s and supervisors," 

— "The higher your grade, the higher your MPS [merit pay 
system] rating . " 

--"Supervisors in my division have been given dispropor- 
tionately higher ratings than those they supervise," 



INCLUDING EMPLOYEE^ : WITH DIFFERENT 
' RESPONSIBILITIES Tft THE— SAME- POOfc 
CAN INCREASE EMPLOYEE DISSATISFACTION 

When headquarters and* field or, noncareer (Schedule C) 5 and 
career employees are included in the same pool > employees may 
feel they are competing in an unfair environment and that their, 
merit pay increases may hot reflect their performance. As one 
pool official said> "this is [like] ^comparing apples and oranges 
and plums." — 



Including employees from different regions, or from re- 
gion/field and headquarters, in .the isam.e^po.ol may cayse prob- 
lems, one study** showed that field employees wete concerned 



5upon specific a^ithor izat ton by 0PM or under the terms of an 
agreement with OPM, agencies may. make appointments to posi- 
tions in grades 6S-15 and below which involve a close and con- 
fidential working relationship with the head. of ah agency or 
other key appointed of ficials. positions filled urider\_this 
authority are excepted ^frbm the competitive service and consti- 
tute Schedule C. 

^ Ef f etctiveness of Merit-Pay'-Pool Management , James Perry , Jone . 
Pea^ce, and Carla Hanzlik; Review of Public Personnel Adminis - 
tration, Vol. 2, No. 3.^ Summer 1982. . ; 

- *» 
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about being compared with employees in states different 
sizes. A pool manager in Agriculture felt that^ in ht3 popl f 
conditions in different states varied, making comparisons^ of 
performance for the same job dif f icult . in addition* he. had re- 
gional/field employees who were competing with headquarters 
employees. 



In HUD and Navy, a headquarters merit pay employee was more 
-likely to receive 'the highest rating than an employee in the 
region/field . Employees in Navy and HUD headquarters pools had 
about twice the percentage of Level 1 arid outstanding ratings as 
regional/field employees for both years. Comparable data was 
not available for Agriculture. The following table shows the 
difference in ratings iri HUD and Navy headquarters and regional/ 
field pools. 

Table -4 ______ 

>adquarters and Regiorial/frierd 'Ratings * 



HUJD Eerfbrrharice Ratings 



a" 



- Highly Fully Marginal/ 

Outstanding satisfactory satisfactory unsat. 
1981 19t2 1981 1982 - 1981 1982 1981 -15.82 



( percent ) • 



Headquarters 

Region/field « 

* _ _ ] 

Overall 

department 



16 
8 

12 



15 
6 



r 



48 

51 



44 
41 



26 



35 

\ 



9 50 42 31 

Navy Performance Rati ngs 3 



34 
46 

i 

41 



2 
2 



3 
3 



Level > Level 2 Level 3 Level 4 Level 5/6 
1981 1982 1981 1982 1981 1982 1981 1982 1981 1982 



uar- 
ters : 



10 



16 I 



...Xr'i 

30 



(percent). 

34 35 32 



16 



10 



Region/ 
field 



27 i 34 



43 



40 



17 



11 



Overall 
depart- 
ment 



12 



28 



33 



40 



36 



17 



10 



1 



a This table does not include Presumptive Fully Satisfactory 
ratings., ' 



The fallowing employee comments indicate their concern over 
this issue. K 

-5 • * \ 

—"My pool consists of a regional of f ice and 4 field of- 
fices. Field office people, aire, consistently rated lower 
than regional .people Who take the bulk of the merit pay 
Pool." | ( 

^"The system is subject to the subjective twhiit\s ; of^Re- v 
gional Admin is tira tors in our case, fre^expected the field 
offices to tak^ ahard line on ratings . . . . I^happen 
to know he'did not take a hard line on his own Regional 
staff. H ^ 

including rioricareer ( Schedule G) and career employees in 
the same merit pay pool also caused concern at HUD in 1982. 
(Navy officials said £ttiey do hot have any Schedule C employees^ 
under merit pay^ and Agriculture, has separate pools for Schedule 
C employees.} The following table summarizes the variance in 
rating distributions between headquarters Schedule C appointees 
and career employees at HUD. 



. — ^ 5 

Comparison <5f^HUD Headquarters Ratings for 
S chedule G and Career Merit Pay Employes 



"" i _ Highly Fully Marginal/ 

Outstanding satisfactory satisfactory unsat . 

. . — (percent) * 

Schedule C 

employees 3 55 32 13 - ... 

Career 

employees b .. 14 : : > 47 37 2 

^Percentages based on 31 per f b^Ih^-b^^<dl Ratings (thoii for" 
which tfte employee was in. the pool long enough to be rated on 
ftis or her performance) . This was the total number bf perform- 
ance based ratings for Schedule C. employees in HUD. 

r , 

• " a 

^Percentages based on the total ( 778 ) ratings in HUD headquar- 
ters that were based on the employee's performance 

In. 1982, the average merit pay increase for a Schedule C 
employee in headquarterswas $2^314. The average meritpiyl ' 
increase for. all HUD headquarters career employees was $1 r 793. 
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In one IJUD office, all 11 Schedule C merit pay employees who 
received performance-based appraisals; in 1982 were rated as Out- 
standing. They received merit pay increases averaging $2 , 859 . 
Merit pay increases^for that office's career employees averaged 
$1 ,983. - 



HUD employees objected to the policy of placing Schedule C 
employees; in the same pool with casejer civil servants, as shown 
by. their comments. 4 

k — "The system is rife with subjectivity and inherently 

flawed: in placing Schedule G staff in the same pool with 
career staff • . . . 11 " 

— "There should be a separate Merit Pay Pool for Schedule C 
employees — they should hot be in the~same pool as career 
employees . " 

--"The senior officials will find ways to reward Schedule C 
types." 

— "Another major defect [of merit pay] is the inclusion of 
Schedule C merit pay personnel in the pool with .career- 
personnel. The Schedule C s were generally handrpicked 
by the raters or reviewers , thereby making them part of 

the 'new team' or 'us' vs. 'them' career types. I would 

like to know what the average rating and merit pay 
amounts were ... to Schedule C's for^Y 1982." 

--"The system seems to have been politicized, with top 

political appointees changing the ratings of career people 
in order to reward themselves and their appointed 
subordinates." 

OPM does not currently have a policy requiring - separate 
pools for Schedule e appointees who are urider merit pay, but. 
encourages agencies to have separate pools. 



AGENCY FORMULAS jCAUSfi~ Dl FFERENCES 
IN MERIT PAY INCREASES AMONG 



A 



As provided for in the CSRA, OPM allows the agencies great 
Aexibility in designing their merit pay plans and .the formulas 
for computing merit pay increases. Formulas can include vari- 
ables such as the performance salary ceiling* maximum annual 
merit pay increase, and acceleration factor which can be used at 
the discretion of the agency. Ih addition, different values i can 
be used for the points or percentages assigned to performance 
levels* and the number of performance levels can vary. Due to 
the many formula variations possible for determining increases, 
merit pay can be very different far a similar rating. 
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Performance salary ceilings . 
vary pay increases 

Performance salaryf'cei lings limit the salary within each 
grade according to the level of performance. For instancy, in 
HUD, an employee rated Fully Satisfactory cannot advance past 
the, equivalent of step V of the General Schedule for the grade 
until earning a Highly Satisf actory_or Outstanding gating. An 
employee already at "the equivalent of step 8 who receives a_ 
Fully Satisf actbry rating would receive only the automatic por- 
tion of comparability and no merit pay. Agriculture and Navy do 
hot incorporate performance salary ceilings into their merit, pay 
formulas. > V 

OPM merit pay simulations show that, formulas using the j*er- 
fpr^ance salary _ceiling_generally tfe^krd highly rated employees 
with a higher percentage of merit pay than dp other formulas. 
The 1982 pay increases (see app. VIII) show that top-rated HUD 
employees dxd receive more thari their coanterparts in Navy^atid 
Agriculture. ^ " / 

Maximum annual increases' vary ^ 

Although OPM does not Restrict the size of merit pay in- 
creases, some agencies do. Navy limits merit increases to ho 
more than the annual salary adjustment plus one-third of the 
salary range; HUD, to the adjustment plus 15 percetlt of base 
salary; and Agriculture, to the adjustment plus 9 percent of 
base salary. . «. 

Acceleration factor rewards employees 
lower in the salary range 

According to OPM, some agency formulas use an acceleration); 
factor to award__larger_ merit, increases to employees lower in the 
salary range . This alldws them to catch up with equally rated f 
?^P^py^ es _whO/ because of their longevity ^ are higher in the / 
range. The intent is to reward performance rather than iongevt 
ity. OPM encourages- this practice, believing that equally // 
graded, employees getting the same rating shbuld, over time, ./' 
receive the same base salary. Agriculture's formula ihcprpdr- 
ates the acceleration factor while HUD'^s and Navy 1 s do riot. 

— ■ _ _ ,. *' 

The acceleration factor can result in the highest rated 
people, who are also near the top of the salary range, receiving 
smaller merit pay increases than employees lower in the range. 



20 



4. 



0 

ERIC 



Po ints for performance vary ' 

The different formulas assign points to different rating 
categories. The points are multiplied by dollars available^ per 
point to determine individual merit pay increases. (See app. IX 
for a description of how individual merit pay increases are cal- 
culated . } Points assigned to rating categories in the three De- 
partments reviewed are shbwn below. 





Table 6 




>s^" v Points Assigned to Performance 

Levels at Three Agencies 


HUD 


Rating 
Out standing 
Highly satisfactory 
Fully satisfactory 
Marginally satisfactory 
Unsatisfactory 

> 




1982 
3.0 
2.0 
1.0 

0 




Navy 




Jgating 
Lev£$*i (highest) 
Level 2 
Level 3 
Level 4 
- Level 5 
Level, 6 (lowest) 




1982 
2.1 
1.7 
1.3 
1.0 
0 
0 




Agriculture 




Rating 
5.0 (Outstanding) 
4. 5 
4.0 

3.5 - 
3.0 (Fully Acceptable ) 
Less than 3.0 




_1982 
p* 3.0 

* 2.5 
2.0 
1.5 
1.0 

0 



As the table shows^ in 1982^ an Outstanding Navy employee (Level 
l) received 2.1 times more points than a Level 4 employee of 
equal grade. On the other hand, in 1982, an Outstanding (5.0) 
Agriculture employee received 3 times more than a Fully Accept- 
able (3.0) employee of equal grade and salary. In all install- ' 
ces, the dollar value of a point is the same within a pool, but 
would be different between pools unless the pool makeup arid 
rating distribution are identical. 
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_f l? e _P94 rit ? prescribed by the merit P?y_f ormu la ref lect man^ 
&gement ' s decisions about the degree to which different levels * 
of performance Should be rewarded. Thus, Agriculture raised its* 
point value in 1982 for outstanding performance to provide a 
greater distinction in pay between Satisfactory _ and dutstanding 
employees. Navy lowered its point value in 1982 to provide 
greater merit pay increases to more employees. 

Number of rating categories 
receiving merit pay varies 

Agency formulas specify how many rating categories are eli- 
gible for merit pay- For example. Navy had six categories in 
1981 and 1982 and awarded merit pay to the three highest cate- 
gories in 1981 but to the top four in* 1982^ In 1981 and 1982, 
FIUD had five categories but increased the number of categories 
receiving merit pay from two to three in 1982. Agriculture in 
both years had five categories and awarded merit pay to employ-, 
ees rated Fully Satisfactory (3.0) or better. (See a pp. VIII.) 

- i 

When more employees in more rating categories aire eligible 
to receive merit pay from a fixed fund, less money is available 
to each providing other factors are equal. As a result, at 
Agriculture in 1981., average merit pay increases were 7 much 
smaller than at HUD and Navy which awarded merit pay only to 
those rated higher than Fully Satisfactory. Thus, because 
agency merit pay formulas award increases to employees in dif- - 
f erent numbers of rating categories, employees rated as Fully 
Satisfactory in one agency might receive merit pay, while Fully 
Satisfactory performers in another agency might not . Again, the 
agency merit pay formula, and not the employee's performance, 
can cause differences in pay between equally rated employees . 

CONCLUSIONS * I ' . ~. 

Several factors other than performance have influenced the 
size of merit pay increases that employees receive . The effect 
of some of these factors , such as merit pay formulas and merit 
pay pool composition, can be reduced by OPM and the agencies . 
The distribution of ratings in the pool is another factor that 
affects the size of merit pay increases. OPM gives each agency 
great flexibility in setting up its merit pay system, including 
factors that influence pay . Because of employee concerns over 
the equity of merit pay, OPM and the agencies shoul^ strive to 
reduce the effect of these nonperformance factors on pay. These 
factors— can never be completely eliminated, but have taken on 
added significance since the advent of merit pay, because merit 
pay adjustments are now based on the performance appraisal . , 
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GAG- 1 s review found that these factors have influenced the size 

of merit pay' increases more than is 'necessary. 

~* 

OPM can he3?p accomplish this by reemphasizing the need for 
Schedule C and career employees to be placed in separate pools 
and by enforcing OPM regulations which prohibit the forced dis- 
tribution of ratings. The agencies' can also help reduce the 
Effect of nonperformance factors bri pay by _cbhsideririg_ such 
factors as pool size and employee grade arid respdrisibilities in 
establishing their merit pay pools. These efforts are heeded to 
help boost employee acceptance of the merit pay system. 



RECOMMENDATIONS TO 
THE DIRE CTOR, OPM 

We recommend that the Director, OPM, assess the impact of_ 
pool composition and agency formulas oh merit pay increases arid 
develop criteria that will minimize their possible adverse ef- 
fects. We further recommend that* to the extent that it is 
legally permissible, the Director should: * 

--Reemphasize the rieed for agencies to establish * separate 
merit pay pools for its career and noncareer (Schedule C) 
employees, so that Schedule C employees do not receive 
larger merit increases at the expense of career 
employees. <; 

. ■ , _ j - _ _ _ _ _ _ 

— Enforce the* regulations whicV prohibit forced distribu- 
tion of ratings. 

AGENCY COMMENTS C) 

" i j% ~ ; _ _ _ .. 

In commenting on the report , OPM stated that it was aware 
of pool composition problems *and that their October 25> 1983, ' 
proposed regulations would authorise agencies to take pool com- 
position factors into consideration" in disbursing merit pay 
funds. OPM stated it has always recommended to agencies that 
career and noncareer employees riot be included in the same merit 

pay pools. OPM rioted that in sfme cases, such as when the 

agency has only one or two noncareer employees, it is not apprd- 
priate to do so. OPM stated that the October regulations would 
reinforce the prohibition against forced ratings distributions 
arid that it would work diligently to see that this requirement 
is accomplished. 

in its only comment on the draft of this report. Agricul- 
ture stated that the charts in appendix VIII> although techni- 
cally correct, create a false impression that unfair benefits 
are accruing to employees at higher grades . Agriculture noted 
that because higher graded ; individuals have higher base sala- 
ries, they contribute mdre money to the merit pay pool and thus 
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receive larger Increases, They also point but that an essen- 
tially flat distribution^ curve would .result if the increases 
shown in appendix VIII were converted into percentages of 
salary. The charts -in appendix VIII show the actual average in- 
creases received in the three_ agencies in 1981 and 1982 and were 
intended to show the reader the magnitude of the incre^aes re- 
ceived under merit pay, Th'e k charts were not intend^t^mply 
that higher graded employees unfairly received mor^ than ijower 
graded employees. However, the report does show V&&e app, VII) 
that in all three agencies, higher graded merit pay -employees 
consistently received better performance ratings than lower 
graded employees. This was a source of dissatisfaction to merit 
pay employees because it did lead to larger merit increases for 
higher graded employees, 

HUD and POD agreed with the findings, conclusions, and rec- 
ommendations iri this chapter, 

i 
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CHAPTER 3 

PERFORMANCE STANDARDS BETTER , 

BUT STILL NEED IMPROVEMENT 

After 2 years, the quality of performance standards im- 
proved slightly^- but Agriculture; HUD, and Navy managers were 
still having problems establishing standards wh icfa^wer e measur- 
able or that distinguished between performance levels. 

Most merit pay employees responding to our questionnaire 
§ei i e Y?^_ §heir standards were fair, tailored to their l°k, an ^ 
consistent with organizational goals in both 1981 and 1982. 
Most employees from Agriculture arid Navy also bel ieved supervi- 
sors considered their views when setting standards. rlany em- 
ployees , however , were not satisfied with the amount of input 
they had in setting their standards and objected to managers es- 
tablishing identical standards for different jobs. 

The CSRA^ requires that performance standards be communi- 
cated to each employee at the Beginning of each ^appraisal 
period. However, 37 percent of Agriculture employees and 70 
percent of HUD employees whose standards we reviewed did not re- 
ceive their standards until at least 3 months after the ap- . 
praisal p er i°ci began. 

WHAT ARE PERFORMANCE STANDARDS? 

Performance standards provide the criteria for how well an 
employee must perform speci f ic tasks . These standards enable 
supervisors and employees to determine how well ^employees are 
doing their work by comparing their actual performance to estab- 
lished criteria . * 

Although performance appraisal is an inherently subjective 
process, the CSRA 2 requires agencies to establish performance 
standards which , to the extent feasible , use objective criteria 
to accurately evaluate performance . To achieve this , chapter 
4 30 , subchapter 2-3 (b) of the Federal personnel Manual ( FPM) , 
promulgated by OPM, says that each Standard should be object ive , 

realistic , reasonable, and clearly stated in writing,. Each 

standard should be defined so that, both the supervisor and the 
employee know what is expected andrwhether the standard has been 
met. 



1 5 U.S.C. S 4302 7 (b) (2) 

2 5 U.S.C*. S 4302(b) ( 1 ) 
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EMPLOYEES GENERALLY SATISFIED 
WITH PERFORMANCE STANDARDS 



Overall - 9 surveyed employees seemed satisfied with several 
importantf aspects of their performance standards. As indicated 
by the following chart, most employees inboth years in all 
three Departments felt their standards were fair, tailored to 
their job f and consistent with organizational goals. 

I 

Table 1 



Agriculture 
1981 1982 



HUP 



1981 1982 



Navy 



1981 1982 



Standards were fair 



69 



75 



(percent )- 
65 63 



70 



73 - 



Standards were tailored 
to job 



Standards^ were consistent 
with organizational goals 
and mission 78 



78 



84 



68 '% 60 



77 



73 



78 



79 



8(3 



85 



As the chart shows , acceptance of performance standards was good 
in all three agencies in the first year. However f ; at HUD, there 
was a statistically significant decline in employee satisfaction 
with these aspects of standards in the second year. 

PERFORMANCE STANDARDS 
HAVE IMPROVED SLIGHTLY ' 

According to a handbook 3 published by OPM' s Interagency 
Advisory Group ( I AG ) , 4 establishing quality performance stand- 
ards is essential to a successful performance appraisal- system. 
Also under the merit pay program, the amount of an employee's 
merit pay increase is dependent in large part upon his or her 
performance rat ing . 



3 Mag-nostig Gu^.de for Improving the Quality of Performanc 
ments and Standards , I AG . 



4 The I AG Committee on Performance Appraisal is an OPM-sponsored 
group comprised .of agencies 1 personnel directors, their repre- 
sentatives, and line managers to provide a forum for 'sharing 
information about ' per formande appraisal systems arid techniques. 
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We reviewed 12,216 performance standards frorib a\ total of 
950 pferiformance appraisals at the Departments ;df Agriculture., 
HITO*, and Navy for fiscal years 1981 arid 1 982 'ts.. shown below: 



Table 2 « 



Performance 



Agency | 

.Agriculture 
HUD 
Navy 

Total 



reviewed 


1 9.8 1 


1982 


Total 


326 


-2,299 


3,035 — 


-> 5,334 


326 


1 ,099 


2,382 


3,481 


29€ 


1 ,714 


1 ,687 


3,40j* 


950 


5,112 


7, 104 


.12,216* 



The quality measures in the performance standards improved - 
in all three Departments in fiscal year -1982 . However , -we s-.ti.ll 
found standards that 

--were not measurable in terms of quality quantity, arid 
' timeliness and 




—did riot distinguish between performance [levels. ~. : ; - 

Quality, quantity , arid timeliness * *.(>•' 

criteria can improve measurabil i ty ^ 

of standards * * - 

• I , V * 

Chapter 430, subchapter 2-3 (b) of the FPM stated that when 
it is feasible, performance standards should include, among 

other thiffas, measures of quality, quantity, arid timeliness. 

They 1 should indicate how well the work has to be dene Jquality), 
ho# much work is to be done (quantity), and .how soon tne work is 
to be done (timeliness). According to' the I AG handbook, if 
performance standards do not contain these measures, a super- 
visor can expect difficulties in making accurate and objective 
appraisals . 0 , 

J ' _. .. \ - _■ - - - _ - - - 

' ^ Although we recognize that it may not be feasible for all 
standards to contain these measures, many performance standards 
at Agriculture, HUD, and Navy did riot contain quality, quantity, 
or timeliness measures in either fiscal year 19J31 or 1982. How- 
ever, as shown below, in fiscal year 1982 thertf was a statisti- 
cally significant improvement in quality criteria of standards 
in all three agencies. * 
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Table 3 



Agency 



Standards having measures of : 
Quality Quantity. Timeliness 
1981 1982 1981 1982 1981 1982 



Agriculture 

HUp 

Navy 



23 32 
3*L 66 
17V 20 



(percent)- 



56 
28 
42 



52 
38 
44 



42 
24 
39 



37 
32 
33 



Standards which simply restate the. employees 1 duties can: 
make it difficult. for supervisors to objectively evaluate an em- 
ployee 1 s performance. For example , one performance standard for 
an Agr icul ture civil engineer was to : "Respond to request^ahd 
provide assistance to Director of Engineering to help maintain 
the . . . safety program. " This standard does not con^a^n any 
measures of quality^ quantity, or timeliness. 



luality^ quantil 
Another example of a vague and immeasurabie standard is 



the 



fallowing for a Navy Aerospace Engineer : 



"Develop plans for advanced aircraft development pro- 
grams (fixed wingf and/or hel icopters ) . Prepare pro- 
posals , br ief ings , technical rationale documents , 
etc., in support of advanced aircraft development 
programs." 



Agafey this standard does not tell the employee how complete the 
planS ,' proposals, etc . , m£ist be , how many there should be , or 
when they are due . Had the standard rioted that the plans had to 
meet the supervisor's expectation for them, in our methodology, 
the qual i ty measure would have been satisfied. 

, - V - _ _ J -■ V ; : : 

. Employees surveyed who were concerned with the ^Objectivity 

arid/or measurabil ity of their performance standards commented \i3 

follows : ^ ^ 

— "Most performance standards are too vague arid leave too 
much to bpinibrii" 



— "As long as standards are vague [and] immeasurable , man- 
agement can rig ratings any way they want." 

— " [Performance standards] are so broad and vague as to 
allow total subjectivity on part of supervisor." 



— "Quality of performance standards remains the biggest, ob- 
stacle to a mer|t pay system ..it" ^ 
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On the other "hand \ another employee commented that establishing 

quality performance standards "dd^s help to improve each 

supervisor ' s skills in evaluating a subordinate ' s performance in 
a consistent measurable manner. "The following two standards 
include measures of quality, quantity, and timeliness which pro- 
vide a basis for determining how well the employee is doings the 
job. The first example rs a standard defining the "on_ target" 
level of performance fbtja Navy Supervisory Budget Analys^: 

:"' "Submit required Justification Back-up Book data . . 
ho later than 3 weeks after final dollar and t manpower 

controls are received . Special budget exhibit re- 

quiremept^&SLbe submitted NLT [not later than] 1 week 
after submis^on of above. Maximum of three ma*jor 
technical errors caused by failure to follow instruc- 
tions or mathematical calculations . " 

The second example vis a standard defining the fully satis- 
factory level of performance for an Agriculture Supervisory Man- 
agement Analyst: 

"Complete 60% of the service-wide policy for Elec- 
tronic mail; 15% of the policy for word processing; 

arid develop the basis for the electronic filing ^ 

policy. Provide analysis and review of office infor- 
mation systems, .70%. of the studies agreed upon for 
completion are accepted by the Staff Director. Pro- 
vide assistance ajid/or leadership for major office 
system studies such as electronic mail; 70% of these 
efforts agreed upon for completion will be accomp- 
lished within the set time limits." 

Distinctions .between performance 

levels need im provement ^ 

• ; According to the I AG handbook, a clear, concise differenti- 

ation between performance levels great ly_ increases the supervi- 
sor's ancl employee's ability to accurately assess performance, 
if distinctions do not exist, supervisors will have difficulty 
determining the. employee's level of performance and justifying 
tl?e gating giv'en . * 



fit Agriculture and HUD, many standards did not distinguish 
between tme various performance levels.* However, as the chart 
below shows, in fiscal year 1982, both agencies improved in de- 
veloping standards that distinguish between the five performance 
levels used to rate employees. , 



Table 4 



Agency 



Standards 



Outstanding 
to highly 



whichjpaKe perf brmarice d istirictibris from: 
Highly Fully 



satisfactory 
to fully 



satisfactory 
to marginally 



ctory aa t i s f a c t o ry satisfactory 



1981 1982 1981 1982 1981 1982 



Marginally 
satisfactory 
to unsatis- 
f actory 



1981 



1982 



Agriculture 
HUD 



26 
4 



47 
25 



42 
3 



(percent)- 



55 
9 



57 
1 



74- 
17 



43 
3 



54 
56 



HUD requires standards for outstanding, fully satisfactory, 
and unsatisfactory performance to be defined. However , "the 
following set of standards for a HUD Branch Chref are an/example 
of standards that do not clearly distinguish between fully sat- 
isfactory, and outstanding performance: 



Fully satisfactory level of performance 

"Determines effectiveness of policies, procedures arid 
methods of operation .of field office . Participates • in 
field reviews of field Office operations or the . reso- 
lution of specific problems in a field of f ice . " 



Outstanding level of pterfc^Ml a nc e 



.3 



" Regularly determines effectiveness of pol icies arid 
procedures as they relate to the field office opera- 
tions . Participates and/or poordiriates field reviews 
and promptly resolves any problems or deficiencies 
noted . " 



Conversely^ ; the following standards for a HUD Area Audit 
Supervisor do identify what performance is necessary to attain a 
given ra&ing- 

Bu±±y satisfactory level of performance 

. n 90 percent tbf assigned surveys and pilot audits with; 
"related reports and guides which meet [the unit 1 s] 
standards are completed within negotiated timeframes . " 



Outstanding level of performanc e 

'^95 percent Jof assigned surveys andv^piibt audits- with 
related reports arid guides which meebs. [ the unit's] 
standards are completed within negotiated t ime frame s . 1 
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Most of Navy's standards -were distinguishable. 'The Navy's 
system consists of three levels for each element^ jaboye,^below, 
and on targetj , two of which are defined iaboye and on target )♦ 
In fiscal years 1981 and T98X, 74 and 72 percent, respectively^ 
of the performance elements in the Navy appraisals reviewed had 
standards that distinguished between above target arid on tar- 
get . 

:„ a • ; :; 

AGENfflES NEED-- TO IMPROVE . _ ' ' 
STANDARD- SETTING PROCEDURES 

. The CSRA^ requires agencies to encourage employee partici- 
pation during the standard-setting process and to communicate 
performance standards to employees at the beginning of each ap- 
praisal period. At the three agencies reviewed, however , these 
procedures were not always followed, 

_ _ ^ ■•: ■> 

Employees should part icipate 
more in ^setting standards 

A^6ording to a study, conducted for OPM, performance ¥ 
standards developed jointly by supervisors and employees tend to 
result in greater employee acceptance of the standards; more 
positive attitudes toward them; and , n possibly, higher quality 
standards. In addition, those employees GAO surveyed who were 
satisfied to a great or very great extent with the input they 
had in setting standards were more positive about the fairness 
of the merit pay/performance appraisal process in fiscal year_ 
1982 . However, many employees from Agriculture , . Navy , arid HUD 
were not satisfied with the amount of involvement they had in 
establishing their standards. 

While most employees in 1982 at Agriculture and Navy (70 
arid 76 percent;, respectively) believed their supervisors 
considered their views when setting standards, only 46 percent * 
of HUD employees believed this to be the case. We also asfced to 
what extent respondents were satisfied with the amount of input 
'they had into setting r their standards^ Fifty-one percent of the 
respondents in Agriculture, 52 percent in Navy, and 29 percent 

in HUD answered that they were satisfied to a great or very 

great extent. Comments from employees concerned over their lack 
of participation in standard setting included: 



5> 5 U.S.C. § 4-3Q2(aj.( 2 ') . 



Orqani 



asqssments of the Effects ofCjVil Service 



Reform, Case Western Reserve university, Fall 1982. 
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: — "Individual members were ribt__allbwed to set individual 
objectives with supervisors." 



— "Standards were set by [the] agency with no input from 



me , 



— "Performance standards [were] not established or agreed 
to by supervisor arid employee." j 

— " . . .standards are imposed by headquarters, no 
supervisor/employee modifications are allowed." 

On the other hand , one employee who was greatly satisfied 
with his input in setting his standards noted "I like the proce- 
dure of setting jap the performance standards and the specificity 
of defining the work." " „ • 



U n 1 1 mel y come 



standards. remains a problem 



The CSRA^ requires that employees receive critical ele- 
ments and performance standards 2t the beginning of each ap- 
praisal period. According to Chapter 430 of the FPM, effective 
two-way communication about a job before* the appraisal period- 
begins provides, an opportunity to identify and resolve any 
misunderstand ings . 

Many employees in the merit pay pools' we reviewed did not 
receive their set of standards until 6 months or more had _[ 
elapsed in the appraisal period. In some cases, we could not 
determine when the employees received"; their standards because 
they had not signed and/or dated tfienf. / 



7 5 U.S.C. S 4302(b)(2). 
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Table 5 



Sets, of 
standards 



Months after period began that 
standards were received 9 



Agency 



Dated Undated Less than 1- 1-3 3-6 



Agriculture 

1981 135 28 

1982 129 34 



51 
36 



(percent ) • 




7 
22 



6-9 



15 
8 



9-12 



9 
6 



HUD 



1981 
1982 



56 
54 



107 
109 



32 
19 



9 
1 1 



16 

28 



1 1 

22 



32 
20 



NaV ^981 - 108 41 '61 18 18 ? J 

' 1982 123 26 • 64 24 10 0 2 

a-rhese percentages are based on those sets of standards for 
.which we could determine when employees received them. 

As the table; shows, standards were not always promptly _ 

communicated at both Agriculture and HUD, where 14 percent and 
•< 42 percent of the employees, respectively, received their 

standards more than 6 months after the fiscal year . 1982^ 
' appraisal period began. Receiving standards late in th| 

appraisal period was also-mentioned as a problem by employees 

yho commented that: 

' • —"Performance standards [are] given every year at least 
6-8 months into the [appraisal] period." " * 

— "When I asked my supervisor about the 1982 standards 
early in the 1982 fiscal year, . . . [he said] he 
couldn't discuss my standards until management had 
given him his own standards. I received^my 1982- 
i standards 6 months into the fiscal year." t 

„»ln many cases, objectives have not been set^until well 
into the fiscal year [then] backdated. . . . 

Has standard setting improved communication 
between supervisors and subord i nates ? 

One of our 1982 survey questions asked if communication 
between respondents arid supervisors has become, better , worse, or 
remained about the same since mefc*t pay started^ Ten percent 
•from Agriculture, 9 percent from HUD, and 17 percent from. Navy 
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believed communication had improved. Qn the other hand, 1 1 .per- 
cent from Agriculture, 17\ percent from HOT), and 13 percent from "' 
Navy believed communication had become worse, while' 79, 73; and 
70 percent, respectively, said there had been n,o ...change. 

At the request of Navy offk?ial$ r we also asked Navy' re- 
spondents who supervised merit pay employees to what extent - 
work-related communication be tween them and their employees had 
improved. >Seyen percent said that communication improved to a 
great or very great extent, while 63 percent said there was 
little or no improvement. 

. About 75 percehtfef the pool officials irf£ervi£wed after 
the 1982 cycle stated that the performance .appraisal process btfd 
increased communication between . supervisor and subordinate 
within the pool .* in fact, eight officials cited improved ' 
communications within the pool as the primary benefit of the 
merit pay system. j 



>er leyel review can 
|inprove consistency of star 

According to the IAS handbook, for employees to consider a 
performance appraisal system fair, performance standards must be 
consistent for all employees in the pool. Positions with com- 
parable duties and responsibilities should have standards of 
comparable difficulty. Chapter 430, subchapter 2-3(c), of the 
FPM provides that agencies should use the same standards for all 
employee? who have "identical" jobs in the same grade, series, 
and organization. ~A review of performance standards at the 
beginning of the appraisal period by pool managers (or their 
designees) can help entire that standards for similar position^ 
are consistent. ^ 

— - •».■-. 

; Some reviewing officials for the merit pay pools we visited 
did review some or all standards of pool members at the begin- 
ning of £h-e appraisal period even though not required by depart- 
mental merit pay plans to do so. Specifically, in 1982 - 
reviewing officials at 18 of 22 Agriculture pools, 6 of 11 HU0 
pools, and 16 of 24 Navy pools said they reviewed standards at 
the beginning of the appraisal period. 

\ However, many employees believed that inconsistent diffi- 
culty* of elements and standards for the same or similar jobs was 
a problem. Of those surveyed, 36 percent, from Agriculture, 30 
percent from HUD, arid 46- percent from' Navy believed this to be a 
moderate to a very great problem . For example, two employees' 
comments were: — . ^ 

— "Standards and Ratings" are inconsistent among Supervisors 
and even for a given supervisor for. similar jobs." 
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^-"My problem with merit pay here is that different 
objectives are establ ished for similar. positions arid 
the degree of difficulty to* obtain goals* varies 
within' the same unit." 

Some employees also commented on the problem of having the 
same standards for different jobs. For example, they noted: T 

jr-"yje have identical elements and standards for somewhat 
different jobs." 

—"Standards are subject ive and the same for all persons at 
' . the same grade regardless of job." 

— "Regardless* of the position, the job elements and per- 
formance standards ar^ the same." 



CONCLUSIONS 



Although the quality of performance standards improved in 
1982, less than half the standards *y 

— contained object ive measures of .quality* quantity, arid 
timeliness, and 

— many did not distinguish between performance levels. 

Performance standards which contain these features can help 

supervisors make more accurate arid object ive appraisals and can 
enhance management's use of appraisals when making personnel 
decisions. 



Employees need to know what is expected of them arid what 
__ir overall final rating will be based on. This communication 
of standards early in the appraisal period can also reduce the 
likelihood of disagreement when the rating is completed at the 



the 

d 



end of the appraisal period. Requiring greater employee parti- 
cipation in setting standards should help tailor^them to the 
duties of each job. 

It is important that agencies reemphasize the need for 
supervisors and subordinates to jointly establish performance 
standards that (1) include measures of quantity, quality, and 
timeliness to the maximum extent feasible; (2) are consistent in 
difficulty; ( 3 ) accurately reflects employee duties; and (4) dis- 
tinguish between performance levels. Without this emphasis, 
standards may not be fair and accurate criteria by which to 
judge performance; 

Requiring a review of performance standards at the begin- 
ning of each appraisal period by pool managers or their 
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delegates, may improve the consistency and quality of standards 
arid may also ensure that employees receive them ;at the beginning 
of each appraisal period? 



RECOMMENDATIONS TO 
Thfe •DtRfiCT6R; 6 PET " 

We recommend that the Director, OPM, improve performance 
standards and the standard-setting process, to the extent that 
it is legally permissible, by requiring pool managers or their 
delegates to review standards at the beginning of each appraisal 
period. This review should ensure that!, to the maximum extent 
feasible, standards contain the desired~ch~aracteristics of 
objectivity and measurability and that they are of comparable 
difficulty for similar jobs. 

_ - 4 

The Director, OPM, should also require that, to the extent 

that it is legally permissible, 

employees be given the opportunity to consult with their 
supervisors in_ setting their performance standards and 

— performance standards be communicated to the employee 
within a specified Cime after the beginning of the ap- 
praisal period . ^ 

AGENCY COMMENTS 

... , _ ___;^4_^_. ._ : . . ■ 

v : -■_ In its cotj#^h1jg on our?) draft , , OPM suggested that as 
written, thfe proposed recommendation requiring employee partici- 
pation in standard setting could be interpreted as infringing 
upon management's right to assign work . Therefore, we revise! 
the recommendation to ensure that it not be misinterpreted . 

__ ____ _ _ __j 

OPM stated that its October 25, 1983, proposed regulations 

. would require Review and approval of standards, elements, and 
ratings by a supervisor or manager at a higher level than the 
appraising official. OPM noted that employee participation in 
setting standards is fundamental to the success of the perform- 
ance appraisal system and that its October regulations stated 
that the agencies "shall encourage" this participation. OPM 
also said that these regulations would require that performance- 
plans be provided to employees at the beginning of each ap- 
praisal period. OPM expects that i±s oversight activities will 
ensure that this requirement is met. 

HUD and DOD agreed with the findings, conclusions, and. rec- ' 
ommendations in this chapter . Agriculture had no comments on 
this chapter . 
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CHAPTER 4 



MORE EVALUATION AND- 



NEEDED FOR - MERIT PAY SYSTE MS 

OPM is responsible f or establishing ;, evaluating , and 
monitoring merit pay systems governmentwide . CSRA requires OPM 
to analyze the cost and effectiveness of the merit pay system 
and cash awards program and to annually publish the results. 
OPM ' s past efforts to evaluate various agency merit pay, systems 
were limited in scope "and have hot met the CSRA requirement. 
OPM how plans more emphasis ori merit pay evaluation. OPM has 
not ensured that all agencies emphasize and use the cash award 
program as an integral part of merit pay as intended by the 
CSRA. Agencies we reviewed have evaluated and made changes to 
their merit pay systems. 



OPM EVALUATIONS- HAVE EE EN 
OF LIMITED SCOPE 



Since merit pay was first implemented in October 1980, 

OPM's reviews and evaluations have focused on statistical analy- 
ses of ratings, and pay increases and on reviews of agencies 
compliance with regulations^ It not succeeded in^ measuring 

whether the merit pay systemis acgompli^hirigi the goals of the 

nor has it determined th£ cost to implement or operate 
merit pay governmentwide . 

A September 1981 OPM report, Merit Pay: First Year Exper - 
sbences in Eight Federal Agencies, described merit pay formulas 
of different agencies and. statistically analyzed ratings and 
pay. "fT May 1982 OPM pamphlet, Merit Pay in 1980; Lessons 
Learned , summarized data from nine other studies • Both 
studies were b&sed on the experiences of the eight agencies that 
implemented merit pay in 1980 and that employed about 2*200 
merit pay employees^r About 2 percent of the current merit pay 
population . \y ■ ' • 

A January 1983 OPM report. Merit Pay, Fiscal Year 19 82 P ro- 
gram Report , statistically analyzed rating Slid pay data from the 
October 1981 pay cycle . Its findings were based on appraisal 

data from 19, 000 merit pay employees — 16 percent of the merit 

r- pay population. According to OPM, because the da£a were limited 
and varied from agency to agency, "it is not possible to make . 
valid generalizations to the Federal work force as a wholeV 



iThesef studies were conducted by OPM, other government agencies, 
universities, and the National Academy o£ Public Administra- 
tion. ^| ^ 

37 . • 



57 



t 



The report makes rib attempt to assess the success of merit pay 
ih meeting. its goals, ribr does it analyze tfre cost arid effec- 
tiveness of the merit pay system arid the cdsh award program. 

In August 1983, OPM published a pamphlet entitled Signif - 
icant Progress in pay for Performance 1 980-1 982 . This pamphlet 
concluded that 

"the Federal government's new performance ^appraisal * 
system is functioning very well less than two years 
after its establishment . Arid, pay-for-per formarice 
... has been effective in providing greater rewards 
;;■ for^above average performers , while achieving a high 
dfimree of acceptance among employees . " 

- _ _ - _ - _ _ . ' 

These conclusions were based upon ( 1 ) an experiment in 1 980 

involving eight agencies employing a total of 2 , 200 merit pay 
employees ; (2) data gathered by the Federal Employee Attitude 
Survey in early 1980, about 7 months bef ore^nter i t pay was fully 
implemented; (3) OPM's own experience with merit pay; (4) in- 
formal employee and agency comments; and (5) incomplete submis- 
sions of rating and payout data from a;ii the agencies operating 
merit pay systems . At the request of Senator Bingaman^, we eval- 
uated arid reported on this OPty study 2 afad generally disagreed 
with OPM's conclusions . 

OPM also funded university research studies of merit pay . 
One paper analyzed merit pay in five agencies^ and concluded 
that - 



j 



"as perceived by affected employees/ the new performance 
appraisal system does not effectively measure performance 
and therefore does not serve the purpose of the merit pay 
program to f link pay to performance," 



Following the f irst merit pay cycle, Case Western Reserve 
University published a study 4 for OPM, which assessed the 
effect of various parts of the CSRA on employees at five federal 
installations in two agencies . The study commented on the ^ need 
for fairness in determining raifees and bonuses and the impor- 
tance of fairness in influencing acceptance of merit pay as a 



2 Analysis of OPM's Report on Pay for Performance irithe Federal 
Government 1980-1982 , GAO/GGD-84-22 , October 21 , 1983. 

^ Federal Merit Pay: An Appraisal , James Perry and Jone Pearce , 
1982. 



^ Org anizational A s sessment s— of^ 
form , Case Western Reserve Unx 



the Effects of eivil Service Re- 



versity, Fall 1982. 
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system. It also noted that poorer employee attitudes* toward 
merit pay result when pool managers change ratings. 

In a January 1 983 paper , 5 Case Western researchers 
concluded that 

" . . . merit pay is riot working in bur two agencies or 
in most of the other agencies in which evaluations are 
taking place.. By not working we mean that it is not 
widely accepted , it is riot seen as an improvement, it 
: is riot rewarding deserving people fairly with signifi- 

cant raises, and it is not contributing to agency 
effectiveness." 

< 

The paper also noted that 

•■ . . . performance standards arid performance appraisal 

may be working to improve the way in , which employees 

are able to plan and accomplish their work goals. * 

This is . . . Sri encouraging accompl ishment for the 

CSRA and for the prospects for work effectiveness im- * 

proving in tfce federal government." 

¥_ 

OPM HAS_ NOT CONDUCTE D OR PUBLIS HED 
REQUIRED ANA LYSES OF MERIT PAY 
SYSTEM AND— C ASH AWARD E BQGRAM 

_ _ j " • 

The CSRA requires OPM to analyze^ the cost arid effectiveness 
of the merit pay system arid the cash award program and to 
annually publish the results, 6 Although OPM has stated that 
this reporting requirement was eliminated by the Congress tonal 

Reports Elimination Act of 1980, 7 the statute requiring it 

remains in full force arid effect. While OPM has not analyzed . 
and reported on* the cost and effectiveness of these systems, it 
did attempt to determine implementation costs from October 1978 
: to October 1981. However, its estimate of implementation cost 
wa§ not based on accurate submission of data from all the 
agencies operating merit pay systems. 

* ■' •-- — / 

In late August 1981, OPM's Interagency Advisory Group (IAG) 

asked agericies-to voluntarily provide first-year cost data on 

the development, training, arid implementation of merit pay; As 



^ Performance Appraisal: The Fefl ital Experience , -Karen N. 
Gaertner arid Grejjpry H. Gaertnerl, Case Western Reserve Univer- 
sity , January 1 983 ; \ 

5 5 U;S:C; § 5404(1 )". 

7public Law 96-470; October 19, 1980, 94 Stat. 2241; 
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a-* result, «Mts January 1983, M erit Pay, Fiscal Year 1982 
Program RepS pt, OPM estimated the cost governmentwide for 
developing /^tFain^Lng , and implementing merit pay and performance 
appraisal systems from October 1978 to October 1981 to be $43; 6 
million; ' * 

We have some 'concern with the accuracy of this cost esti- 
mate . First/ as OPM noted j*j 5J3 of 89 agencies or components with 
a separate merit pay plan Submitted cost data. For agencies, riot 
submitting data, OPM' estimated their costs using figures pro- 
vided by agencies of comparable size . Second, the agencies re- 
ceived the TAG request in August 1981 long after they had begun 
cfe signing and implementing their systems . This required them to 
reconstruct and estimate costs incurred since 1978. Third, 
agencies were asfcfed not to include either the time employees and 
supervisors spent setting standards and preparing ratings or the 
salaried of employees^ in merit pay training . Finally, OPM esti- 
mated Navy's contractor costs to develop the performance 
appraisal and merit pay systems cit $6 . 6 million, understating 
the actual costs reported by Navy by $3.*4 million . - * 

EMPLOYEE COSTS TO CARRY OUT 7" 
PERFORMANCE APPRAISAL FUNCTIONS " . 



MAY HAVE DECREASED IN -THE ; -SECONI 



Our questionnaire to Navy, HUD, and Agriculture merit pay .- 
employees asked them to ^estimate the time they spent setting 
standards , preparing ratings, and counseling staff in fiscal 
years^ 1980, 1981^ and 1982. Using their responses arid the aver- 
age salaries of merit pay employees in each agency, we estimated 
employee costs tp perform these functions, as shown below. 



\ 



Table 1 



Estimated Costs of Performance Appra is a l _Fanct i on s 
~ for Fiscal Years 1980 through 1982 

'^f Navy HUD Agriculture 

------------- (millions ) ----------- 



Fiscal year ^1980* $6.1 $1.1 $3. 7 

Fiscal year 1981 11.7 1.2 5.8 

Fiscal year 1932 9. 5 . 9 4. 2 

a Employees estimated time spent on performance appraisals ni 
1980 jr the year before merit pay was implemented, about 15 N 
months after th<=> end of the fiscal year. They made estimates 
for 1981 arid 1982 about 3 months after the end of each of these 
years . (See app. X for details on these estimates . ) _ 
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The chart shows that estimated employee _«'osts . increased 92 
percent in Navy and more than 50 percent in Agriculture the 
first year of merit pay (1981). In HUD and-Agriculture, these 
costs decreased to at or below fiscal year 1980 levels (when the 
comparability increases are factored out). A' possible reason 
for the reduced costs from 1981 to 1982 is that, -in, 1981 , the 
process o-f standard-setting was new, while, in the second y ear ' 
employees were more comfortable with the system and, thus, re- 
quired less time. Only in the Navy do fiscal year 1982 cost es- 
timates greatly exceed the pre-merit pay level (1980). A Navy 
personnel official suggested that these costs did not 'decrease . 
to pre-merit pay levels because, in the Navy, the standard- 
setting process has been made an integral part of the 6vefall 
Navy planning process -aj-id requires a great deal of time\^f 

: ■' I 

NEW OPM EVALUATION STRATEGY , ■ 5 . . 
EMPHASIZES MERIT PAY EVALUATION , • \ 



TO help carry out its responsibilities for evaluating the 
merit, pay system and the cash award prpgram, OPM has established 
an Office of Performance Management, which will, among other 
things, evaluate performance management in federal agencies^ 
The evaluations and special studies of the merit pay system will 
be performed by the. Analysis and Evaluation Division of OPM. 

One responsibility of the division is "evaluating the im- 
plementation and /administration of performance management pro- 
grams in FederaF departments arfa agencies for effectiveness and 
compliance." The Evaluation Branch of the division has been re- 
duced to six employees, who will receive somejfeupport from OPM s 
regional offices to carry out their planrtej reviews. OPM >of fa- 
cials said that any further decrease in evaluation staff would 
qreatly impair its ability to complete its evaluations. The , 
branch initiated two major studies in 1983. . The first examined 
the effect of various factors — such as pay pool size, composi- 
tion, and management; location of pool members; .and the quality 
of performance standards and elements— on • me^rit pay system oper- 
ations. Other topics. the study was to address were 



the extent and impact of rating changes during higher 

level reviews ; « 

the link between performance appraisal and organizational 

effectiveness ; >S 

the effect Of merit pay on" individual motivation and per- 
formance; 

—employee and manager perceptions and. acceptance of merit 
pay ; and 

•Vis ' ; } 
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_. — the actual .distinction in merit .pay amount^, cash awards; 

and total pay rates and tHSi^f^lafcion to ratcLnqs. ; 

This study, to be completed by February 1984, is a nationwide 
project involving 35 installations at 18 agencies. Tn the sec- 
ond planned study, agency performance appraisal and incentive 
awards programs will be reviewed for compliance with the law and 
regulations and for quality and effectiveness. This study is to 
involve on-site agency evaluations of at least 34 installa- 
tions. However, OPM must also analyze the cost associated with 
the merit pay system and the cash award program an«l publish' the 
results annually as required bu statute 8 

OPM NEEDS TO ENSURE THAT, " * ' * ' " j '' ' 

CASH AWARDS ARE USED AS A N * \ . ; .' ' "' 

INTEGRAL PART OF MERIfr PAY * s - 

SYSTEM ' I ' . ' \< - - > 




Under the CSRA„. cash awards; are supposed to be an integral 
part of the merit pay system. They can be used to reward 
employees for outstanding performance and to reward those whose 
top performance is not reflected in( their merit pay because they 
were at the top of the salary range or were newly promoted and 
not under merit pay long enough to be appraised. Cash awards ' 
require little additional paperwork since they are? supposed to 
be based on performance, and performance is documented by the 
employee's annual appraisal . However, OPM has not ensured that ' 
all agencies are using their cash award programs as an inteqral 
part of merit pay. < .» ' : : • ...|* . 

: . • "' - ( ' ' 

As a result, the three Departments established cash awards 
programs and supported them with varying degrees of emphasis. 
Navy emphasised its* cash awards program in both years; Agricul- 
ture and HUD did note. Therefore, Navy granted larger cash 
awards to a larger percentage of its merit pay employees in both 
years. According to personnel officials, one reason for the 
variance among the Departments was budget restrictions in 
Agriculture and in HUD. The differences in the dollar amount 
and percentage of awards 'made in the three Departments in 1981 
arid 1982 are shown oh the following page. 



5 U.S.C. S 5404 ( 1 ) 
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SUMMARY OF CASH AWARDS: 



PERCENT OF MERIT PAY EMPLOYEES GETTING 6ASH AWARDS AND 
AVERAGE AWARD AMOUNT 



Percent 
35 



Percent of Merit Pay Employees 
Getting Cash Awards 



30 
20 




pttfal 1982 



u. 



31- 




\ ■ 



HUD 



Agriculture 



Navy (note bj 



^ Na*9\pol»CY on cash awards changed from 1981 to 1982. In 1981. the number of awards at each activity was 



mited to 15 percent of its merit pax^pfoyees. In 1982, the percentage was not limited, bat the dollar 
amount was restricted to 1 percent of^&e salaries of merit pay employees in the unit. , . 



At*The average-award amount for the .entire merit pay population was not available for 1981. The amount 
shown for 1981 is the average for the units visited in the Washington. DC. area. 
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' AGENCIES - HAVE IDENTIFIED AND \ 

eORRECTED-SOME FIrEt-YEAR PROBLEMS^ I 

*ii three. Departments hav| evaluated their merit^ay sys- 
tems and gathered attitudinal datZ ff^xh 'employees or supervisors 
about merit pay. Each Departments made changes to its system 
based on the^e^evaluations . 

The HUD evaluation identified several areas heeding im- 
provement, including more. consistent standards, better justifi- 
cation of ratings, and rules for assigning overall ratings. To 
v remedy these problems, HUD ' 

. _ -* _ _ 

— recommended an upper-level review of standardsTat the be- 
ginning of the appraisal period; 



-developed "model managerial elements and standards" and a 
^performance appraisal package" containing examples of 
we 11 -documented ratings ; 

— required written justification for all ratings other than 
Fully Satisfactory; and 

-^implemented "decision rules" to use in determining ah 
overall rating when individual elements ^receive a differ- 
jl ent rating score. j." 

Agriculture's evaluation task force identified several 
merit pay issues .needing ^ttention . First, it not;ed that qual- ' 
ity . and consistency of standards within its organizational units 
needed >£o beyimproved and recommended that Agriculture establish 
a library of/performance standards and act as a center of exper- 
tise to assist these units. Second, it noted problems with doc- 
umenting employee jbb_accomplishments and reaffirmed that they 
must be documented . Third, it concluded that the formula used 
in 1981 did not adequately reward above average performers. 
Therefore, it recommended changing its merit pay formuLa tp in- 
crease the difference in^pay between different perform ank^ 
levels. The revised formula adopted by Agriculture made a 5.6 : 
(Outstanding ) rating wor£h three times more than a 3.Q (Fully 
Successful) rating for employees in the same grade and position 
in Jche— salary range . • 

, Agriculture also surveyed its merit pay employees in 1981 
on their attitudes toward merit' pay andconcluded that a great 
benefit* of the new performance appraisal system was the in- 
creased communication between supervisors and employees.. It 
also noted several causes for employee negativism toward merit 
pay, including . * 
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\ — small differences in pay, despite fairly large differ- 

ences in ratings; 

— the time and effort required to implement and administer 
r « the hew system; arid 



--the fact, that many Fully Satisfactory employees received 
less than they would have under the old^system. 



% Navy has conduced several evaluations of its merit pay 

system and also u£ed our questionnaire results to better under- 
stand employee concerns. Following the 1981 pay cycle Navy 
devaluations found that • 

— >pobi managers believed the merit pay system was too 

time-consuming, with excessive paperwork, and provided 
disappointing pay; • m ■ . < . 




--the most significant problems pool managers cited were . ^ 
setting m^ningf ul and measurable objectives and the time 
to, admi,ni^te\r the system; * f~ 



standards We?e,; in some cas^s, overly quantitative; 




— .ratings were changed during^the review process with no 
justification provided ; 



1 -gratings were high for higher graded employee*; arid 

} ' . ' _ . ;'..'r _.r\..T: ,/ / 

— Strong points of the system, according to< p^qal . managers , 
W6-re pay for performance, increased interaction between 
supervisor and subordinate, comparison of command (orga- 
nisation) goals to individual goals* arid differentiation^ 
df f 'f§ood per formers from bad. 

The Nayy changed its system for the 'appraisal period start- 
ing July 1982 because of tjie problems discovered. Among ^hese 
changes, the Navy 

—required that changes to ratings be justified on therat- 
{ 'ing ' form and communicated to the employee within 90 days 

of, the end of the appraisal period?- ^ 

— required few&r performance reviews during the year; 
— simplified £ts appraisal forms; 

— made secdnctrlevel supervisory reviews of standards op- 
tional but ftpcouraged an up-front review of them by re- 
view boards appointed by the pool manager to ensure 
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equity among pool members ' 15 tandards arid the timely 
establishment of standards; ^ 



— Informed raters that higher, level merit pay employees 
already are compensated for'\their broader authority, arid 
responsibility by a grade adjustment factor and, there- 
fore , do not^ need their ratings raised for this reason ; 
and 

— made it acceptable to use more subjective approaches to 
measuring performance, thereby reducing the emphasis on 
quantity as a measure of performance. 

-. 

Following the 1 982 pay cycle, Navy sent a guest ionnairejto 
P99l managers and members of boards designated to review stand- 
^r^s^and ratings' for the pools. Some results were favorable k 
toward performance appraisals. For iristawee, these pool maria- w 
gers believed 

— the System helped_ focus managers ' and supervisors 1 atten- 
tion on organizational goals (EK3 percent), . i , 

— they were able to adequately reward their high \per formers 
with pay increases ^nd /rash awards '( 54 percent ) 

' . . li_ - 

--Jcomm.un i cat ion within their merit pay unit increased ( 55 

r percent ) , and . 

--the 1982 performance evaluations accurately reflected ' the 
worth of employee contributions to their organization 
( 66 percent^) . • • * 1 

CONCLUSIONS ? " ' 

— - - - * * - 

OPM efforts to evaluate merit pay have beferi limited . , It 
has not accurately determined the cost of implementing and oper- 
ating merit pay systems. It also has not analyzed the coSt and r 
effectiveness of the merit pay system and cas+Caward program and 
published the resul^aa required by law. 

OPM has estaE^iisftfed a new organization (Office of Perform- 
ance Management) whicij wiii evaluate jnerit pay in the future, 
including its effectiveness arid impact bri : employee motivation 
arid performance . Its new emphasis on evaluation appears promis- 
ing. However , the* number of staff assigned to carry but the 
strategy is limited and may experience difficulty in conducting 
the reviews; as planned if the size of the staff is decreased, 
OPM has riot ensured that all agencies are using the cash award 
program as an integral pajrt of merit pay. 

1 ■ • \ 
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The three Departments reviewed have evaluated their merit 
pay* systems and made changes based on their evaluations. These 
actions were steps in the right direction. 

RECOMMENDATIONS* TO . 
THE DIRECTOR/ OPM 

in order to improve the evaluation arid admiriistrat ion of tfre 
merit pay system and the cash award program _ we recommend that 
the Director, OPM, to the extent that it is legally permissible, 

—provide adequate resources to maintain planned merit pay 
evaluation efforts; ^ / ■ 

—publish Annual reports which analyze the cos t. and effec- 
tiveness of the merit pay system and the cash award 
- program; arid 

' --clarify the intended role of the cash award program for 
merit pay employees and provide guidance arid oversight 
that will ensure that it is .used as an' integral part of 
merit pay. 



AGENCY COMMENTS ;'. 

OPM concurred that it should provide adequate resources to 
maintain their' evaluation efforts and pointed out the establish- 
ment of the Office of Performance Management and its plans for 
future evaluation. OPM believes that it is responding to our „ . 
"cost arid effectiveness" recommendation . OPM stated thao it is 
currently per forming studies which will address how effectively 
the merit pay program is achieving CSRA objectives. OPM does 
not believe it is necessary ±o report on the costs of the merit 
p?ay ; system 'because " : ^fi<^ total payouts under merit pay are the* 
•same^ the General Schedule. How- 

eVen, the " 1^ ^ iregSi^s^tj^ajb ari annual report on cost and effec- 
tiveness be published, ^ h^s not- kept track of the costs 
required tp impl^eht pr. pperiat^ and the time 

spent for performance appraisal functions— the administrative 
costs of actually making the payouts could be substantial. 

OPM stated that its October 1983 proposed regulations would v; . _ 
require that performance awards become- a mandatory part of merit y ■ ^- 
pay arid that agencies submit to OPM for approval a pla* speci- . 
fying how the^e awards are to be distributed and the ^tount to \ 
b<* funded by the agency for such purposes. - " > ^ 

DOD and /HUD agreed with the findings, conclusions, and r£c- 
ommendations (in this chapter. Agricul ture had no comment on 
this chaptej 

<K f ' 
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CHAPTER 5 



EMPLOYEES R ETAI N NEGATIVE 

- " - — — — 

' PERCEPTIONS OF MERIT PAY SYSTEM 

Employees' perceptions of their merit pay systems will play 
a large role in determining whether merit pay succeeds. While 
in the second year employees .believed there were some . improved 
aspects of merit pay, such as the system taking less t;tme to 
operate, in the three Departments we reviewed -, employees ' over- 
all perceptions; about merit pay remained negative. 

MbSt employees, including €op performers 1 who received :th& 
largest merit pay increases , believed the system had- riot been 
successful. We did find slight improvements ; in; Navy respon- 
dents 'perceptions after the 1982 merit pay cycle. However, 
most respondents in all three agencies at the end of both years 
believed that the system had riot increased (1) motivation or. (2) 
performance/productivity. Merit pay pool officials. also held 
the same negative attitudes expressed by surveyed employees. 

While between 37 and 46 percent of the employees in each 

Department in both years supported the concept of merit pay f 
less than 10 percent favored retaining the current merit pay 
system in their Department. Many believed the current system 
had riot been administered fairly and that performance ratings - , 
under merit pay were more subjective than before. 

EMPLOYEES SKEPTICAL ABOUT THE. 

MERIT PAY SYSTEM'S INTENDED BENEFITS 

After the 1981 .and 1982 pay cycles, many respondents did riot 
believe that the objectives of merit pay were being met. Re- 
spondents felt that motivation, productivity, arid performance 
had not increased under merit pay. Pn addition, in both 1981 
and 1982, about 80 percent of each Department 1 s surveyed employ- 
ees did not believe the benefits of the merit pay system justi- 
fied the additional time required to operate it. After, the 1982 
-cycle, however , respondents who believed the benefits of merit 
pay^ justified the effort it required increased from 7 percent to 
1 1 percent in Navy, from 11 percent to 13 percent in HUD, arid 
from 8 percent to 9 percent in Agriculture. Only the increase 
in' Navy, however, .was statistically significant. 



"Top performers" are defined in this report as tljose who in 
Agriculture , were rated at 4.5 or higher (out of 5.0 ) ; in HOD, - 
were rated Outstanding or; in Navy-; were rated Level 1 ' 
(highest rating). 
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'Respondents believed that productivity did riot increase 
under merit pay. About 80 percent of the respondents iri both 
years reported that they were rib more product ive under merit 
p^y. Further, after the _1982,,pay cycle, less than a quarter of 
each Department's top performers reported increased productivity 
under merit pay. Over the 1'981 and 1982 period, of the respon- 
dents who supervised merit pay employees, approximately 75 per- 
cent believed Sheir merit pay subordinates^were no more 
productive as % result of the merit pay system. While 5 the per- 
centage of supervisors who believed this remained fairly con- 
stant? in both years at Navy and HUB , the percentage increased 
in Agriculture from 62 to 84 percent from 1981 to 19*82. 

5 . Surveyed employees. Were more satisfied with the amount of 

their merit increases after the 1982 p5y cycle. After the 1982 
. cycle, when more merit pay fundi were Available because of the 
, increased" wi thin-grade* contributions mentioned earlier ( see 'pp. 
7 and 8 ) , more respondents in each Department felt the amount of 
merit increase they had received accurately reflected their per- 
formance* . The percentage of employees who believed this in- 
creased from -1 Spercent to 27 percent in Navy, from 10 percent 
to 26 percent, in HUD, and from 8 percent, to 25 percent' ; in Agri- 
culture - Among the top 1982 performers in each Department, 
about 50 percent felt their merit pay accurately reflected their 
.performance ,. 40 percent said it did not , arid 10 percent were not 
sure . 1 ■§ 

Over the 2-year period, about 80 percent of Navy,^HUD, and 

* 'Agriculture respondents said that the merit pay systemftiad not 

* increased the pressure on theg. to falf 1 11 their: job duties and, 
responsibilities. This- percentage remained virtually unchanged 

* f qr- both years. 



.» \ employees express support for merit pay 
Concept, but want current application~of 
System revised or dropped '. 

- _ " According to a recently published OPM survey, 2 almost half 
of all ?senipr-level supervisors bel ieved that , in principle, 
mef il a^g^^i||aj^' Many ■ employees surveyed also sup- 

ported ^t^i ?i ' ^55^ ^%^S! < ^ ( see question 10, app. III). 



"._ /^oS^fi^b^tieS^ 
t^y^'^fipl erne ri tk&- 



Ib.;s than 10 percent of the respondents 
retain the merit pay sy|&m as cur- 
i even among the top performer? who re- « 
®pq^%<3y. jless^fc^ft^P^ercerit favored retaining the system "as 
is 4 '* • 6e tween^ 3-^ :$9 percent of both years 1 respondents in 

. ^ . ..^. ^^J^0w^ t ^i tu6e ^ - OPMf 198 3 . 
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each Department favored Retaining merit pay but wanted the sys- 
tem revised. Almost half the top per formers in' HUD and Navy and 
about a third at Agriculture shared this opinion; Approximately 
half of all surveyed employees wanted to return to the General 
Schedule for pay increases . The percentage of employees who 
wanted to return to the _61d system decreased from 49 to 44 
percent in .Navy* from 55 to 50 percent in HUD>_arid from _56 to 53- 
percent in' Agricul tlire^ _ after the V982 pay cycLLe. the decrease 
in Navy was statistically significant , trfie decreases in HUD arid 
Agriculture were riot. 

Employee feelings about the performance appraisal system : 
were more positive than toward the merit paj ?y st€? rru For both 
years, the percentage of surveyed employees who wanted to; keep, 
their agency's appraisal system ranged from 27 percent in Navy 
to 4 3 percent in HUD. Further, betweerK„34 and . 49 percent of 
each Department's top per formers _favor£cf retaining their per- 
formance appraisal system even if it were riot linked to merit 
pay . * 

Respondent comments 'showir^f their concern for the way the 
merit pay system was implemented included: 

— "The concept of merit pay was good in its initial . . . 
stages. However it has been inequitably administered and 
as such has not produced the benefits that were supposed 
to accrue from it;" 

--"The in ten t ions of merit pay are good , equitable imple- 
mentation is impossible." 

EMPLOYEES QUESTION FAIRNESS ' a "' 
OF MERIT PAY SYSTEM 

.. . , _ 

A 198 3 University of California study, 3 funrlpd b^ OPM, 
states / that the link between merit pay and performance apprais- 
als — specifically their accuracy arid fairness — is critical to 
the system's general effectiveness . Although the CSRA calls for 
bbjective performance ratings to ^he* maximum exterit feasible, 
after two appraisal arid merit pay cycles , 40 percent or more of 
our survey respondents in each ^Department believed that the 
appraisal process was influenced by favoritism. 

A fter the 1982 pay increases, between 28 and 48 percent of 
•each Department's surveyed employees reported that ratings had v 
become "more, subjective since merit pay was implemented , ev£n 



3 Fttflef£ji Merit Pay: A Longitudinal Analysis , Jone pearce and 
;J^Tfle$ ^Peirpy;, Graduate School of , Management , University of 
iZeti 4| i a , fc f I r v ine , 1983. r v 



- - - # _ 

though appraisals Under the hew system were to be based on ob- 
jective criteria to the extent feasible. The percentage of top 
performers _whb shared this Wew ranged from 22 percent i n _Nayy 
to 36 percent in Agriculture^ Between 68 percent and 74 percent, 
of ail respondents reported that subjective ratings were at ^ 
least somewhat of a ^rob v lem in their pool. 

. The following comments reflect employee concern about sub- 
jectivity arid favoritism in the ratings: 



---^'The Merit Pay System . . . fosters favoritism. people 
' per forming "s imi lar jobs with essentially identical out- 
^ . p.uts get ext-reffl^rly varied- ratings . . . . The system is 
* not handled objectively as intended." ^ 



-•"ih^^ppearance o.f fairness and equity is important in 



ffl — r^J(y pay system. in my agency, . t>he^ Credibility >bf the 
; _ ; _ me#it, pay system has . been| un^etl'irily by the significant 

. d^ff f erences be tweep rit'ih^' given in *the various ^rierit 

pky pools." ^-r ; - .f 

; — :MThe system requires too much subjectivity on the part of 
•• ~ rje v i e w£ r s , a r*^ : t'e nd to faster unfair preferential 
y trreatment . " ; 

; - • , i- -.4 •* 

'—".I am concerned ov^r favoritism, bias, and cronyism in 
ratings ; " V ' 1 

Af t<*r completing two appraisal and pay cycles, employees 
doubted the system's overall fairness. Sixty-three percent of 
HtJD respondents, 44 percent in Navy, and '43 percent in Agricul- 
ture thought merit pay and performance appraisal .systems were 
unfair in fiscal year 1982. Between 27 and 43 percent of those 
employees who said they earned more merit pay than they 'would 
have under the old system character ized the overall system as 
unfair . On the other hand, among Agriculture',' HUD, a'nd Navy , 
top performers, 47, 54 , and 6 V percent , respectively, believed 
the merit pay system was fair. f 

MOTIVATING IMPACT OP _THE _'_ 

MERIT PAY SYSTEM IS QUESTIONED 

A basic assumption of the merit pay system is that the pos- 
sibility of increased pay motivates employees to improve their 
performance. Respondent comments, discussions wi£b merit pay * , 
pool officials, and an independent study of merit $tay indicate 
that the amount of merit incre^es f has not motivated merit pay 
employees . \ 



nployoes , 

••ft 
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Ah QPM-funded UreLtfersity of California study* based on the 
first-y^ar merit pay cycle concluded that 

. .a diverse sample of Federal managers do not 
* appear to be more highly motivated under merit pay * 
than under the previous ^irae-in~grade_ compensation 
policies . • . . These managers report th^t effort. is 
less likely to lead'to a good performance rating* Eahd 
that] merit pay does not encourage them to do jtheir 
jobs well or contribute to their agency's 
ef f ectivefress . " 

Our questionnaire results showed that in both years, 
between 78 and 86 percent of the respondents in the three 
Departments believed t^hat merit, pay had not motivated them to 
perform bette^ Ambng the top performers in each ??P air tment, ^ rt 

1981 between To and '79 percent thought Mat merit pay had v not . 
motivated them to better performance . In 1982, between 61 and 
75 percent, of the top performers shared ^this view. On^y in Navy 
was there a statistically s^£jhiiicant increase iri the percentage 
of 1982 respondents wto believe^ that merit pay motivated 
them-79 percent in 1981 to 13 ^percent in 1982 . Further, in all 
three' Departments, less than JL percent of the respondents in 

1982 said they were motivated to a great or very great extent by 
the merit increases awarded to top performers in their .pay pool. 



Loyee and pool official responses /raised questions _ oh 
the degree to which mor>ey is a motivator for merit pay employ- 
ees . When asked to what extent tooney helped motivate them to 
improved job performance, a1j»ut 20 percent in each Department 
responded that it helped *to ^ great or very great extent, 
another 60 percent said money 'motivated' them to some extent or a 
little, and about 20 percent said money did not motivate tfiem at 
all. In another survey question* we asked employees what per- 
centage increase to their salary would have motivated them to 
better performance, and about 45 percent in each Department 
answered that money did not motivate them to better* perform- 
ance 1 . Even among the top performers responding td^this ques- 
tion, between 3 5 percent and 45 percent in each Dejjwtment gave 
the same response . \ ; "* ■ < 

Some of the narrative comments submitted by- respondents * Ifn 
the Departments following* the 1982 pay cycle include t]^^ 
following: 



4 Federal Merit Pay: A Longitudinal Xnalysis , Jone Pearce and 
James Perry ; Graduate School of Management, University of 
California, Irvine, 1983 . 
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— "The primary motivation oh v riiy part Was the feeling of ^ 
doing a gg^d job and the approval of my peers. r j 

- ----- * 4 - ■ 

— "Money does not really motivate me in the perfdrmance of 
my job ^ . _ ; . However, in terms of _my perscaJial job 
satisfaction, I would like to believe that performance 
is being fairly rewarded . . . ." 

--"While money is not a motivator to^-s^flfe^ perceived un- 
♦ fairness in the^dis tr ibut ion o£^>ferit pay definitely is a 

de-motivator . " 

— "Professional personnel don't need merit pay to 
motivate." 

Three pool -officials cited factors other than money as^motiva- 
tors, including respons ibi i i ty , status, and recognition , as pri- 
mary motivators. - ^ 

— "Merit Pay/ can motivate people , in theory, but drily at 
the lower levels Where you can define jobs/productivity 
easier i » v ; 

JOT " , % t * 

JJ< « ■ ____ ' . , , . : . ; - . ' ■ 

— "Merit Pay has not motivated people to better perform- 
ance . At GM level, people are motivated to do well on 
their own." 

— "Motivation) 1 especially in relation to higher graded em- 
ployees, is more a function of status an^ recognition ^> 
than money . " ■ \ y 

MOST MERIT_PAY_PDOL_ OFFICIALS 

HAVE NEGATIVE PERCEPTIONS OF MEftlT PAY 

Comments received from pool of ficials during Both: surveys 
generally echoed the perceptions of merit "pay -employees about '. ; 
the effects of the merit pay system. Some officials , however , 4 
did believe that merit pay was producing some positive results. 

V v _' _ Sixty-four percent of the 141 pool officials interviewed in 
.both years said that merit pay had no effect on employee produc- 
tivity. Seventeen pool officials in 1981 and 13 in 1982 thought 
some of fcheir employees were more productive, while 6 in 1981 
snd 5 ^in . 1 982 felt the system was countertfrodact ive because of 
the time required to operate the system which left less time for 
employees to perform their normal duties. 

Fifty-three percent of the officials 1^1 the second survey 
indicated that merit pay had rib effect on employee motnrat ion . 
Forty-four percent, however, said that merit pay has the poten- 
tial — if administered properly — to motivate employees to 
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improved performance and productivity. Most £aid> however, that 
under current funding ieveis> there is insufficient money in the 
system to .motivate employees. f.. 

Sixty^three percent ^of the pool of ficials interviewed in 
1981 arid .73 percent in 1982 said that one effect of merit pay 
was 3 decrease in employee morale . Reasons cited included ( 1 
subjective appraisals which resulted in unfair distributions of 
pay anS ( 2) small pay different iais which did not recognize or 
properly reward varying levels of performance. 

CHANGES TO MERIT PAY 

HAVE BEEN PROPOSED ' > _ \ ^ 

The negative employee reactions discussed above and many of 
the merit pay problems discussed in chapters 2, 3, and 4 have 
been recognized by employee un ions-^pr i\rate researchers , members 
of the Congress , and other t government agencies. As a result, 
many espouse basic^ changes to the merit pay system. For exam- 
ple/ OPM has proposed regulations^ and bills have been proposed 
that Would, in dMferent ways, alter the ^e^f the merit pay 
system . < 

OPM " s proposed regulations scheduled to go into effect on 
November 25, 1983 , would have, among other 'things, 

* --guaranteed the annual comparability adjustment and an 

average annualized equivalent of a within-grade increase 
to everyone rated Fully Successful or above; 

- - - / * 

--specified a minimum funding level to be used for perform- 
ance awards; • ? 

- . . ' _ . _ .. -J^_ * • _ . 

— guaranteed a minimum differential in. total performance 
pay of those rated Outstanding over those rated Fully 
Successful; 

; . ; _ _ __ A_ _.. 

— required agencies to have five summary rating levels ; 

— prohibited forced distribution of *rat irigs ; arid - 

— -required agencies to provide higher level management re- 
•view'bf the performance appraisal process in the interest 
of employee equity arid i,n order to reflect organizational 




5Federal- Register, Vol- 48, No. 207,' October 25, 1983, pp. 
49472-49491 .- ^ V 3 
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The regulations also covered other non-merit pay subjects 
such as reductions- in- f^rce and performance appraisals .v ;On 
November 12, 1983, the Congress enacted legis latioh t'o block 
their implementation . GPM, however, believed this legislation 
barred funding of the regulations but did not invalidate the 
regulations themselves . On December 30, 1983, the U.S. District 
Court declared null and void and enjoined OPM N f rom directly* or 
indirectly taking any; action on the regulations. Th<is_court 
decision was rendered* in responseto^ suit brought against OPM 
by the National Treasury Employees Union, which sought to have 
the regulations set aside and declared null and void . 

The proposed legislation, the Merit Pay Reform Act of 
1983,7 would prohibit OPM and agencies from forcing the distri- 
bution of ratings , guarantee the annual comparability adjustment 
and within-grade increases to merit pay employees . rated Fully 
Success ful or above , require five rating levels , and establish a 
performance awa*d ( bonus ) program for merit pay employees. 
« * 

CONCLUSIONS 
~* T 

A key factor in the eventual success of the merit pay 
system is how it is accepted and judged by ..those employees par- 
ticipating in it . After completing two appraisal and pay 
cycles , employee acceptance shows slight improvement ; however, 
wider acceptance i$ needed to increase merit pay 1 s chances for 
success . The improvements in attitudes- -should they continue — 
may indicate a greater employee willingness - to accept the system 
if they ^perceive it as accurately arid objectively linking raft- 
ings arid pay to; performance . However , we agree with OPM and 
congressional leaders that some changes are needed _in *the cur- 
rent merit pay system to ensure that ^nonperformance f afctors ^do 
not adversely affect merit pay increases. 





Ify OPM and the Departments take steps to ensure' greater 
equity in ratings and pay, merit pay is more likely to gain 
wider employee support arid acceptance. -This, in turn, will en- 
jianc€ its chances of success. 



[^ National Treasury Employees Union v. Donald J. Devine, Civil 
.AcMon'No. 83-3322 . ' 

7 £fcHate Biir S. 958, 98th Congress, First Session, March 24, 
1§83; and. House Bill li.R. 184 1 , 98th Congress, First Session, 
ftfarch 2; 1983. 
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NINETY-SEVENTH CONGRESS 



MARY ROSE OAKAR, OHio. CHAIR 



COMMITTEE ON POST OFFICE AND CIVIL SERVICE 



•!^a t «^A*ii[So« dam kl. ■. crank. h_l. — ' ®.£r>. %)o\\&z of JUpretfentatibeg 

•um IAVAQK, UX_ 



606 

Washington. 2D.C. 20515 



SUBCOMMITTEE ON COMPENSATION AND EMPLOYEE BENEFITS 
608 HOUSE OFFICE BUILDING ANNEX t 



TELEPHONE (202) 225-«S3t 

December 9 , 19 8 1 



J 



The Honorable Charles A. Hows her 
Comptrdl let General 
t General Ac. counting. Office. 
Washington', D . C. . i D" 5 4 8 . 



Rear Mr . ^ow-sher, 



As required by the Civil Servi ce Re form Ac t '* o f 1978, 
most Federal agencies implemented thejr performance appraisal 
and merit pay System for the first time J in- October 1 9 8 1 * These 
"ft stems , which cover between 1 2 0,00 and ISO, 000 OS- 1 % through ■ 
employees, are designed to link pay. with performance. 



1 5 



In light of problems with merit p;iy, s ys teni .'Amp J emcn t a t i 6n 
already, andj because of our continued interest ifh the success 
of _the merifcr^ay program, we would like the Gon<i;ra 1 Account i ng 
Office to rev Few the status of jiierit pay implementation in. cer- 
tain agencies, and provide a report o.f agency' activity. We 
would like the report to include case' studies of the merit pay' 
program at two or three major Federal agencies which i nip 1 c merit e 
their systems in October 1981. 



We a p p r e c i a t e t Ire w o r "k your office H a s don e 
A ~ s 11 ^ _ i n t h o p a s t a ri d believe t h e r c - i s nS* o d to 
monitor agency efforts to successfully iitiple^ieht 
Your assistance will be grea Vl y. apprec i a tetH 




v 

on - this 
con t i nua 1 1 y 
t c h is p rbg ram . 



Mary Ri 
('ha i r 

SufrctVrfnu t-tye on Com pi nsdt i on 
O/yee^.Beiu^l^i.t s 
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MAIL SURVEY OF MERIT PAY EMPLOYEES 



We surveyed Agriculture, HUD, and Navy merit pay employees 
to assess their attitudes toward the system and their experi- 
ences with merit pay • ' We sent a questionnaire to employees in 
February-.. 1982 abc*ut the f isc^J year 1981 implementation of merit 
pay. * In^January ^983, we sent another questionnaire asking 
about merit pay iri^its second year. - 

INITIAL SURVEY PROCEDURE (FISCAL YEAR 1981^ 

The questionnaire used in the first madl survey assessed 
employee attitudes , experiences, and beliefs related tb the fol- 
lowing aspects of merit pay: 



--Time derated to performance^ appraisal duties and 
functions . ^ 

— Adequacy of training in performance appraisal ' 
functions. . 

— Extent to which performance standards were linked to em- 
ployees 1 .jobs and ^o organizational goals. 

— f. 

^-Whether *p/irformance appraisal was implemented accord ing 
to mand^ed procedures. ' 

— Fairness of stafodair<5s arid the merit pay system. 

ee to whi-dfa 'ratings arid merit pay increases reflected 



* performance . 

Perceived benefits of merit pay, including general organ- 
izational K Bene fits and effect on employees 1 motivation, 
^productivity, earnings, etc. 

— Desire t'o retain merit pay and the performance Ap- 
praisal system. _ * 

3 Mail survey procedures arid sample designs varied* for ^each^L- 

of the three -Agencies . In HUD and Agriculture, our question- 
naire wa„s attached to agency, questionnaires on merit- pay , The 
questionnaires were' sent to all nierit pay employees in t®e two 
agencies. HUD arid Agriculture did '^&>tf use followup question- 
naires or contacts, 



The initial survey of Navy mefir-pay ? m P$°y? e£J wa ^ md lfi e ky 
GAO independent of any agency^ effort ,andV was * rant to a randpm 
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sample of merit pay employees. The initial sample size. arid _the 
method used to draw the sample were both designed to allow for I 
high level of precision, arid^orif iderice in projecting the find- 
ings to the universe, A second mailout was used in the Navy 
survey to increase the resp$hs,e rate * Standard instructions , 
which explained the purpose* arid use of our questionnaire and 
procedures for answering, were included in ail *tpr&e surveys . 



SECOND YEAR SURVEY ( FJ^CAL- YEAR 1982) 
i ■ — — — — V" • '" ~ 

The second -year survey questionnaire contained i terns used 
in the initial survey except* for questions about the adequacy of 
training . In addition , the questionnaire was expanded to in- 
clWe items on problems with merit pay and performance appraisal 
that had * been mentioned in written comments in the first-year 
survey . ** v 
- ' • • [ 

In the second-year survey , pfoceduf es ?nd sample designs\ in * 
all three agencies essentially repliqated those used in the jni- 
tial Navy survey. In each agency, the questionnaire was sent by 
us to a random sample of employees apd one f ollowup mailing [was 
used. The samples were drawn according to the same" method as-_ 
the initial Navy survey and, thus, were designed to be of sufti-' 
cierxt size to prpject with high confidence to the populations,/ 

. - ..-/ • ■_" • r ... . 

Although the samples in. the secoijd-year survey wer^ n<?t de- 4 * 
signed to^include the same people as the initial survey r some 
overlap between respondents in the two surveys occurred ./.In 
^lavy, abqut 18 percent of the second-ye^r suryey respondents 
said that they had also participated in the initial survey. 
Overlap in the Navy samples occarted as a function of the same 
people being drawn at random in the 2 years. Because our ini- 
tial questionnaire was sent > to all merit pay employees in HUD 
and Agriculture, it is not surprising that over one-half 6Cour 
followup survey respondent's in those two ^gencies (52 percent, 
and' 58 percent, respectively) reported hajfeng 'part icipated virj) 
the initial survey. ^ ' \ 

RESPONSE RATES ^Rv BOTH QUESTIONNAIRES, ^ X J 

< Quest ionna^^W-^^Wt Iptic's related to response rates are pre- j/- 
^tfed^n the t^Fle^belbw. As the table indicates,- relatively 
<$0Z< response rates were obtained in the first-year HUD arid a 
.^jricul ture surveys. The* possible effect of' nonresponse bias , 
which would exist if nonrespondents in the two agencies differed 

rorii respondents on bur questions , requ ire's caution in project- 
ijW our initial survey f ind ings to the universe of merit pay £ ■ ! 
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employees in the two agencies. Statistical testssJere made to 
determine whether HUD and Agriculture respondents differed from 
all merit pay employees in the two agencies on grade level, age, 
and most recent performance rating — three variables possibly re-' 
lated to attitudes toward and experiences with merit pay. • - t 



Basic Q uestionnaire Statistics 
j • 

; V Und^liver- > < ; ' : 

Size of _ Number, able ques- , Number _ Response 
Agen j p y universe 3 sampled tibririaires responding^ rate c 

First-year survey _ ' ? y. (percent ) 

HUD A ^1^ ^ 198 2,198 % 1 ,364 ' 62.1- 

Agriculture ' 9,667 9, 667 ■ £p£ 5,541 5*9.7 

N^yy. 4 * \ > 16,095 624 " ' \ V41 ^f 49 94.2 

V'V '- v _* : '_ "'■ * , : - " fd* 

Second-year survey » *• . ijf. 'V •? . '- 'j 

HUD 2,174 ' 643* 18. S64 . . 90.2 

Agriculture 9,536," - 58*6 35 \ ^491 >: 89.1 ^ 

Navy 15,963 > 580 : s 26 ' - 499 90.4^ 



a Universe and sample sizes refer to merit pay employees only. 

^For HUD and Agriculture, number responding *eiguals number of 
z ysable responses. That is, number giving at least one answer 
■" to the GAO sections of the purvey,. 

^Response rate' equals number 1 responding diii^d by number 
sampled less number of undel ive^able .quesj^ionna'ires . 

' i ■ _ * . ■' ' \ ; _ m 

dsince questionnaires weret~distr Lbuted by local personnel- - v 
of ficers according to up-to-date records , we assumed that' 
all questionnaires were del iverable-; ( i . e. , all employees -could 
be located ) . u .\ : ; • * t ? 

e Pro rata es t iiffSti^ased upott 450 u rid e 1 i v e r a b 1 e s irr x a totee^ 
i mailout of 1 0 74t> [ including 9<687 merit pay employees and' ^ 
1,079 General Schedule employees grades 1 3 thro ugh^WJ*. 



Neither HUD nor Agriculture respondents differed by. a sta 
tistically significant margin from all merit payoemploj^ees on 
grade level. Sighif learns differences, however , were found on 
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performance ratings and age . A somewh^tNiJ^r'^^ of 
respondents in_ both agencies reported high- performance ratings 
than would have been expected bafeed on the Ratings of ail merit 
pay employees . jThe Agriculture sample also^ tended to be younger 
than the universe of Agriculture merit pay employees. HUD re- 
spondents were similar to their population group in terms of 
age. Further analyses revealed however , that these differences 
.would hot bias bur findings or r bias them by only "about 1 to 3 
percetitacje points toward more positive evaluations of merit 
pay. Thus, while the possible effect of non^esponse bias re- 
quires \caut ion in projecting our initial findings to the popula- 
tion, especially in^HUD, the comparability between respondents 
and the universe found in most of our tests and the sizable num- 
ber* of respondents irt. the initial^ -surveys gives us qonf iidenpe in 
making inferences and conclusions - , based on our*data , about the 
first. year of merit pay. / / 

Nonresponse* bias in the first-year surveyj also introduces 
possible ^error in making inferences about changes from the first 
to the second year of merit pay. Jrpbrder to minimize the pos- 
sible <*f fects of nonresponse bias in- HUD and Agriculture, only 
the second-year data from respondents who reported participating 
in the first survey ^fejre used to analyze differences between our 
initial and subsequent findings. > 

CONFIDENCE INTERVALS / 

~~ X __ _ . * >^ 

The results- from a statistical sample are always subject, to' 
some sampling error because only a portion of the universe has t 
been selected for analysis.. The sampling error consists of two ' 
pafts: confidence level and confidence interval or sampling er- '* 
ror . The confidence level indicates the degree pf co/ff ide^ce , „ , 
that can be placed in estimates derived from the sample^ . The 
sampling error or confidence interval is the range in which the 
actual universe results are; located with a certain probability. v 



t The sampling errors presented ~below show the confidence in- 

tervals at the 95-percent confidence level for both surveys in 
the three Departments . ^ * ' ./ 
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Sampling Etrrolrs^at 95 Percent Confidence Leve^ , 

Observed percent 




First-year survey 

— f*-*' 



HOD ' i ■ 

Agriculture 

Navy 

Second-year syre^ey 



HJ4P 

Agr icul ture 
Navy 



10 ,or 90 



ft .0 
+0/5 
+ 2.3* 



20 or 80 





5£L 



Confidence intervals for other reported percentages can t be in- 
terpolated. This assumes that our respondent^ represent the en-| 



tire group from which they were* selected . For ex 



if 10 



percent of Navy employees who answered bur second-year question— 
naire preferred tip retain the merit" pay system** as itr*is, then we 
.cari say that we aie 95-^ercent. sure that- between 7.4 percent and 
12.6percent of alll Navy meri't pay employees wish to retain merit 
pay. V v ; ..'i ; - 



/_ * • 

The confidence intervals, reported 



are^ for findings 



regarding all merit pay employees' in each D^artment* FindinTgs 
concerning subgroups of jneriljj- pay /employees may be associated 
with dif f e-rent levels of precision an^ possibly . wider confidence 
Intervals than those, for all' merit pay^employees depending on 
the size Of th& subgroup universe and the ^lumber of respondents 
in *-the subgroup. 7 • ^ 
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FMPIDYRE RESPONSES TO GjjD (XJFSTIONNAIRFS 



IN 1981 AND 198? 



_ Pelow :are gues t ions taken from our second-year (1982) Questionnaire r arid em- 
ploj^e^re^ponses to both the firsthand second-year questionnaires, When these 

*stions refer to a oeriodjDf time, such as fiscal year 1|>82, you may assume that 
the 1981 questionnaire referred to a comparable period, hut a year earlier. Ques- 
tions 2 arid 5 vrere answered only by those who supervised merit pay employees, the 
others were sup^Dsed to be answered by all reSpo^erits. Questions 1 r 2, and 3 re- 
ferred to the most recently completed fiscal vear, while Questions 4, 5, and 6 re- 
ferred to one year earlier. For example, those employees respond inq to Questions 
4, 5, and 6 in 19^1 were referring to fiscal year 1980. Some questions were asked 
in 1082 and not in 1981 arid vice versa, ^tiese have been identified in the text. 

ireTFPfXXTITON 



The U.S. , (general Accountinq Off ice (GAO) is an aoency of the Conor ess respon- 
sible for evaiaatina^federal proorams. ^At the request of a conoressional Subcom- 
mittee, we are 'currently examtninq the merit pay system in its second ^ear and 
would like you to respond to the following quest ions. This survey is a followup 
to the study we conducted last year of 'ybui: aoency's merit pav system. Your 
answers at*e vitallv^t^r-tant, as we wilf use them arid last year's findings to in- 
form the Conqress aboilt employee opinions on merit pay implementatii$rt in the first 
*2 years. Please give your frank and honest opinions. Also, please be sure to 
answer all of the Questions. Ttie questionnaire should require no more than 20 
minutes of ybur time. ^ 

Please check the box which. best answers each Question. Space has been pro- 
vide^ after the lafit question for makinq narrative comments on any merit pay sub-, 
iect. Any coiTrneriffiBfce appreciated. Itiank you. 

1. The first qu£s«6ns refer to your supervision, if any, of merit pay employ- 
ees. Supervisory functions Under roeritfoay involve settinq performance stand- 
ards for the subordinates you directly supervise, ratinq them, arid counsel inq - 
them. How many merit pay enployees (C**-13 f s, _GM-14 f s, ^M-1B^s),^if §ny^ did 
you supervise in FY 1982, the second year of merit pay? Please count every GM 
employee directly supervised "in FY 1982 (i.e., October 1, 1981, to September 
30, 1982); 

P. 

Aqriculture HTJP Navv 



1981 



1982 '1981 1982 1981 1982 



ERIC 



None (Go to question 3) 
1-3 employees 
4-6 employees 

7^9 employees 

10 or more employees 



62 









(percent)- 






66 


70 


64 


67 


69 


68 


18 


15 


19 


18 


'21 


19 


9 


■ 9 


9 


11 


6 


10 


3 


2 , 


3 


, 3 


7 


2 


3 


3 


: 4 


1 


2 


1 


82 








r 





t 



0 
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^2. In FY 1 982, approximately how many hours* if any, did you spend performing 

supervisory functions related to standard setting f perfotltiance appraisal, and 
counseling on the average per merit pay employee you directly supervised? 



Agriculture 



HUD 



Na 



IfSrl T981 f58? T98T TO 



far 



^lone 

1-8 hbtirs^ or 1 day or less per 



9-16 hours, or '1 to 2 days per 
/ee 



17-24 hours, or 2 to 3 days per 

employee 

25 hours or more, or more than 
3 days per employee 



.23 



18 



19 



13 



27 



29 



47 



18 



20 



21 



14 



41 



- (percent )- 

31 
40 

18 § 

i 

11 



28 
29 
34 



1-1 



15 



37 



24 



14 



In FY 1982, about how many hours, if any, did ^ou spend developing performance 
standards for your position and being counseled by your supervisor concerning 
your performance? ' 



Agriculture 
1 981 1982 



BHD 



Navy 



1981 '1982 1981 1962 



(percent)- 



None 


6 


5 


16 


16 


2 


2 


1 to 8 hours 


: * 45 
<* 


59 


58 


67 


22 


38 


9 to 16 hours * - 


i 25 


22 


16 


11 


29 


30 


17 to 24 hours 


V v 1 1 


9 


5 


2 


19 


15 


25 hours or mpre 


14 


6 ; 


5 


3 


28 


15 
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about^your supervisory responsibilities in FY 1981, the first yeat 
of gjerif pay (i.e., October 1, 1980, to September 30, 1981 ) . How many merit 
pay J employees, if any, did you directly supervise in fiscal year 1981 x> ' \- 



Agriculture 
1981 1982 



HUD 



Navy 



1981 1982 1981 1982 



-faperceritj- 



Nqne AGo to question 6) 

1-3 employees 

4-6 employees 

7-.9 employees 

10 or more employees 



71 


72 


56 


68 


70 


70 


16 


• 15 


24 . 


18 


21 


18, 


8 


9 


12 


1 0 




19 


3 


2 


4 


3 




1' 


2 


2 


4 


2 


2 


' 2 



5." In 1981, about how many hours, if any, did you spend performing supervisory 
functions related to standard setting, performance appraisal, arid counseling 
on, the averse per merit pay employee? y> 



None * 

1-8 hours,, or 1d§y or less 
pgr employee ; sj 

... _ - ;.. 4 

9-16 hours, or from 1 - 

to 2: days per employee; 



17-24 hpurs, or about 2 to 
3 days per employee * I 



25 hours or more* or\nore than 
3 days per^mploye^ 



Agr i culture 



HUD 



T9BT TO 1981 1982 




61 

?3 
9 



16 



15 



30 



21 * 



it- . 
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6. I|ipF^ 1981.9 hew much tiip~ if any, did you : 'spgnd iji developing your . inform- 
ahofe standards and tein^oxmsel^ by your supervisor * concerning gour -^ T - 



performance? 

% . 

None 

.1 to 8 hours 
9 to 16 hours 
17 to 24. -hours' 



25 hours or more % " 

3 - 
What was your most re 

your October 1982 itieri 



1981 



Agriculture . . ' HUD 
1981 1982 1981 1982 

— (percent) — 



.Navy 
1981 .1982 





16* 


5 


.} 22 


. 164. ' 


20 


7 

'.1 




69 


50 

» 


62 






29 




9 


. 25 


9 


13 / 


10 • 


'.. 23 




3. 


• 11 

» 


3 


4 


5 


17 




3 


9 


"4 


2 


11 . 


23 




rating (that is, the brie upon Which 
determination was based)? \ • \, 



jjgrxcoltarg^ 




9 



•HUD 

1 98 rN 982 



I 4,5 - 5.0 
4.0 - 4.4 
3.5 - 3» 9 
3.0 - 3.%. 

< 

Below 3.0 



• i 



^5- 



(percent) 



j \^jjjt> ucu h-j xi iy , fc 14 

/ •' --s - '• ' 1 v . .. 

/ Highly satisfactory K 53 
' Fully satisfactory <- y \3 1 





Marginal 
Unsatisfactory 



I 

43 
44? 
1 



Level 1 

Level 3 
sLevel 4 
Level ? 
Level* 7 
Level 



t 


10- 


13. 




34 


34 ■ . 




41" 


37 




13 




or 6 


2 








4 



r '65 
* > 
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^ 8. The following questions ask opinion concerning- various aspects of the 

merit pay system and ycnir (^xpe^enCes with the system. For each question-, 
^ pJeSse indicate your opfbion by' checking the one box, either "Definitely yes," 

; H PrQbably yes,^ "Don* t know/toot sure," "Probably not;" "Definitely not^" which 
bgst answers the question. v y .£. ■ . ^ . \ \. . m J 



; a./Did you spend tpb much time setting standards, preparing ratings, and| 
vk • • counseling merijt pay employee^? 17 



i 



- • v- 
Aqriculture 



HOD_ 



ERLC 



•definitely 




T§8~1 T53T 1981 , 1982 1981^982 J ' 




IP". 



y -j. 



1% 




yes 

DonVt know/Not sure 
* Probably not 
^De^initely^ not 



? W 15 

■. 2r / 34 

t (4 ,- 

24 „■ 27 




.28, , 46 -J 20 21 



b. 4ias merit pay moti\^ted i you.to better per'fo 



1 

Definite!^ yes 
Probably yes • 
•n't krtow/^t sure 
pbabiy not , 
Definitely not 



1981 1982 1981 -1982 1981 /4&8^ ' > St 

ntj— — 




(V 
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c. 



Have yqp become more productive a? a result of merit pav? 



APPENDIX III 



.Agriculture 



Su b 



^ Naw 



Definitely .yes 



Probaf^^ yes 



Ntori't kr 



sure 



Probabl/y riot 
Definitely not 



d. ran your productivity- be accurately, measured? 



Definitely yes 

Probat>ly ves^ 

Don ■ 6 know/Not sure 



Probably «toot 




1981 1982 






11 


12 








■ 


28 " 


25 




1b 


8 










55 > 


39 



0R1 1982V 1981 1982 

— —j~L 3 

( Percent ) -V— — — r 

13^ A*> - t& 1-1 



ihiteiy riot 



.1 



15 



16 



y do fiie general benefits* if Jiw, of the 
J (or unit) Justify the* additional time 



over what it refcja 




23 # 23 



ffl nay prboranu in your pay ^ 
=F6rt, if any,' o» the program 



Agriculture 
.1981 1982 



HT1D 



--i ' 
Na\^6 



1981 19F 
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(peri 

2 


sent)- 

2 




9 


\fi 


4 


11 

^-29 


26 


5 
19 


49 




69' 









1?82 



4* 
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f. DicLthe amount of merit^pay you earned for y< 
19?2 accurately reflect the qu^litm of your 

:ure 



T981 



1982 



Dt^initely yes 
Probably yes' 

V 

^on't know/Not sure 




not 
initely not 



g i Did your most recent xjfer; 



1 

7 

13 
22 
58 




I 



performance in fiscal year 
rfbrmance? 



1 - 1982 > 1981 1982 



64 



5 


3" 


: 5 


21 




>22 


6 


' 9 


11 


K 




" 20 


47 


59- 


43 



, ^.Ance^ rating (i;\ei% 'the one oapon which your 
October I982 m^trit alternation was Basled). accutfate^y inflect the 
quality of your perf||^anc^imiring jche ratir|g pSrio*^^^ 

ft ■ 4 -\/ *Agrlcu&ure HUD / Na\ 



# 



Definitely yes 



""Pfobaliiy 



* Doh't 

bably not 






-Definitely 



11 


" "9 


40 


41 






-12" 


y ii 






18 




19 


' 21 



4Q: ■' ;: '36 
. ,4t • Vv4 •. * . 8 ^5 / 



13 



28 * 35 



h. Were your performancle standards and elements for 'fiscal y*ar 1*982 tailored 
to yotir particular job? ~ ■ r > . — ~ — L * . . 

? j . ^ • v ' > • / * 

. I ■ xMi<-;ii.;.-it; HUD ^ Navy 

19^1 If" 



A 


gricultu 


pe 


1< 


111 ' 'IS 


32 



Def irfitejy' yes" 
Prdbably-yes , * • ' 




APPENDIX III 



V 



APPENDIX III 

\ . : 




i. Were your^ perf ^fcnai i ce standards and elements consistent with the goals 
^nd/or missiort 8jf your organization? 



Agriculture > 

1981 1982 1981 .1982 1981 1982 



HUP 



i 



(percent)— 



Definitely yes 


32 


37 


29 


29 I 




43 


Probably yes . j. ' 


AS 


47 


48 


44/ 




42 


Don't know/Not sure 


11 




: 7 


7 


9 


' 6 


Probably not 


7 


5 ? 


* 9 


•11 


7 


'• 4 


Definitely ^hot ^ 


5 


3 ' 


7 


8 


5 


5 



f-j* Were your (FX 1982) performance standards changeqt after your supervisor ; had v 



prepared the rating 



w%5 based on^ those standards? 
Sicuiture HUD- 



Definitely yes 
Prbblably yes 
* Don* t 4^nbw; 
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, v; 
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r 



1. Did your supervisor take?*youi? views irito-acwurit when setting your 
standards for if iscal year 1982? ■ 

v Agricu ltug er ^HUD 
1981 



1981 1982. 1 9gj I 
- ( per gent ) — — 



Definitely yes 
Probably y es 



Don' t know/Not sure 
Probably not 
, • Definitely not ^ 



38 • 
34 ' 

9$ 

9 

10 v 



38 
32 
9 



; t< 
29 
10 



6 ■ 1~3^- 



15 



is 



21. 
25 
9 
15 
■31 



48 
28 
6 
9 

r> 9 




m. Were your star*IB|fds for f iscal yeaq. 1982 fair? 

'~ : - - • n : : 

if 3 * Agriculture • HOD 

1981 ' 1982 V 1981- 1982^ . 1981 1982 



S3 

ERLC 
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APPENDIX III 



v .3$l v Wetfk'.any changes in your ratifies documented or explained to you? ' (.If there 
^*-^^i^r.tt^.chaiga' to the rating your supervisor gave you, please cha*k Don't 
' * ^'Wiow/^ok sure. ) ~ ' 



- V 



Def initeiy yes 
Probably- yes 




Agrici 


jlture 




HUD 


* Navy 


19&1 


1982 ' 


19R1 


1982 


1981 






i 








6 


6 


-(percent)- — 
7 7 


- 11 


10 


4 


2 


3 


r 2 


5 


3' 


* 79 


78 


73 


72- 








2 


2 ^ 


^ 1 


2 


3- 


9 


12 


■ 15- 


18 


13 


12 



Definitely nBt 



p. Should the performance appraisal - system instituted under merit pay be 
retained, eyen if it is not tied to merit jaay^ 



"HUD 



1981 1982 

- 1 L 



1981 1982 1981 19^2 




Definitely yes 
Probably yes 
DoiVt knoft/Not sure 

obablynot '; 
Definitely not 



11 

26 

A 



( percent) 
13 




8, ..' 


1 


8 




32^ 


20. 


24 < 




13 


11 


9 




13 


v 19 


- -' i 

16 




'^14 


43- < 


43 





q. under merit pay, do you feel more; pressure tp fulfill the duties and 
responsibilities of 'your job than yis^u d^. prior to merit pay? 



ture 



HUD 



-1981 

T— 



1982 



1981 . 1982 '198j~ 
•(percent)-: *$*f 



er|c 



Definitely yes 

^\ _- - 

Probably "yes 

Don't know/Not sure 

Probably not 

Definitely not- 

K j V 



1 



6 
29 
46 




4 
11 

3 
29 
52 

1 



6 

10 

5 
27 
53 




APPKNDIX ITT 



APPFNDIX III 



r. Thinkinq about your earninqs last year in*to\ 1982 (October 1, 1981, to 
, September 30, 1982), did you earn less under merit pay. than you would have 
under the old GS schedule, iricludinq &nv within-qrade increases you were 
scheduled t6 receive under the bid System? - .- # ' 



nAariculture 



HT1D 



vNavy 



( 



19&.1 ,1982 1981 1982\ 1981 198 



Definitely yes. 

Probably yes 

_ <_ * 
) Don't know/>*ot sure 

- *" 

Probably not 
Definitely -not 




• (percent) 




13 



30 
12 
17 
22 
"Iff 



s. Again, thiakinq^slbout your 'total earninqs. last year (i.e., 
1982) , $id vou^aifh more, than you would b^ve uride^ the old 



AaricQltgre 
^981 19.32 




82 19B*} .1982 




r 
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t. Have vour merit -pay ^^r^^^e^beoo^^^re productive as a result of 

" ' * ^ " .supervised merit pay 

SSI vear 19R2. J 



merit 
emp 



it pay? (Onlv answer this cwestions ^ffjfpu. 
rtovees fGM-13's, HM-14's, 'C^fSia^in 




Acrriculturg 
1981 r J 38 2 



9. Has me 



Definitely yes 

•Probably ves - * 

- • ' 
Don't know/l^ot jfeare 

. S ' 

Pifebabiy hot ; 
K 

Defih^elv riot * 




merit pav increased ; decreased, or had net effect on teamwork and coopera- - 



tibri within voijrt^pooJ^ 



Agriculture^ 
1981 



PUD 




29B2 : 1981 1982 



198V 1982 



— T^rcent)- 




increased teamwork/cooper a t ion 
a ; qreat deal* A * * " 



Mo effect, team<^k/cx^peir§tion •} 
about- the san^'al'^lpelPore ftetit ,;p£v aa^ed 
//< * ^ • - ,. r , / , 

Decreased ^eaitTwork/ccoperatipri. .« 
somewhat . - *r . . 'i^ 3?? 



Decreased beamwo: 
arareat deal 



cue lunuwinq would vou most prefer*? r (Check only one.) 

.A 



HUD <f A Navy' 
198V 19RV 1982 1981 .4982 ± 



merit pay system as it is 

Retain" pay based bri merit but revise 
the* system from what it is now 

Retury po the old CtS, schedule to 
determine pay - 



- f percent )- 



Other r Please describe) 

v. 

Ouestions- 11 through 29 were asked in 1^82 only. 

, -11y Ir^eneral, how fair- was the performance 
, (FY 1982)? „ : ^ - ^. . 

• ' Aqricaltare 



7.- 




6 > 


4 


7 


31 


31 


33- . 38^. 


36 


39 


56 


53 






44 








12 


10 



pay system last* year ' 




V v 



f 
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1:1; was your FY 1982' salary ah the top of your grade level's pay scale? 



Agriculture 



Yes 
No 

Nbt sure 




HUT) 



-( percent )- 



Navy 





7 


ii 


11 










•* 










3 


4 


3 



14. Tncl uding the 2-percent federal pav comparability .increase and any merit pay 
increase you may have received for FY 1<*83, by what percent of your FY lQft2 
salary has your pay increased for FY 1983? iw, * • . 




Agrxcdlture 



Navy 



-'( percent )- 



?nt to 4 percent 

nrcent fed. 6 percept 

?rcerit to 8 Percent 

J^;1 Percent to 10 percent *. 

. r 10*1 percent or more 

non't Know/Mot sure * 

* Cm,: ' . .. - - ^' 

-15. ^lSkina Wout the cumulative effect/^ yjpur pay increases in^he first 2 

tfN years of merit s pav, will vou earn more, less, or about the same in FY 1983 a$.. 
• ^Vtifc -would* have^ under the old schedule, including any within-orade increases 
' *you we.te schedulecTto receive in-th^se 2 years? (If you are a capped, 
employee , please consider your earnings on paper.)- ' t . 



20 






31 


22 . 




4? / 






27 


44 




23- 






17 
10 


22 


i 


.1 

t 

9 






3 
12 


' 1 : ; r 
r*') ; a • ' 


t 

* V -- 
i 



r 



More* * 
Les^~ 




* About the same r\ 

_ T 

Don't Jcnow/Not sure 
JN$t? \appl i cable 



Agricult ure 
H 
2fl 



' - »4- 



N^yv 



■ ( per cent) - 
20 
44 
19 
16" 



1 



23 
37 
2fi 
10 

2 



» , 



75 
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16. including cc^paraBility arid merit pay, what wag|tfc minimal "pay in<3:<§ass over*'****** 
: your FY 198^palary, if any, thtet would have itotlyated you to better ? 
performance this year? ; ' y- - 



S 



Agriculture HUD 
\( percent) - 



Navy 




4 percent or less 
4. 1 percent* to 6 percent 

6.1 percent to 8 percent 

; 1 

1 percent to 10 percent 

"5^ More than 10 percent 

* Don 1 1 know/Not sure 

Money does hot motivate" me to, 
bettet performance^ 



T7. The follqwing r ar^^6s5ible 
pay systems as, 
what extent, if- 
great extent," 
krx>w/fet sure. 





K 


3 


2 


3 


i i 


4 


2 


9 




10 


8 


15' 




• 14'-.; 


15 


14 




■ 11 . 


17 


12 


# • 


14 


: 11 


46' 




i 44 


44 



1 



in your pay*; 



s c^f th^ perf otinance appraisal/meri^: , 
1 and agency. .Please vindicate to 



each occurred - by checking a' very x great extent/' *Tb a 
som^' extent," "To a littffe extent," "Not at all," or "Don 1 ** 



c 




c x: 

JU _Q) 

C 

<ts *u 4j ' c; 
ib * c 

Z **t <D <D Xf 

? &) _ <tj a 



C9 



a; 



or 



o 



4J - 



_4J 
o 

f 



t did .the • systems operate 
t according to established 

J> '^W Agriculture * 
j^avy , 



, -15 
5 
13 



25 
16 
29 



-perdent- 

19 9 
21 14 
2 % 11 



4 
9 
4 



28 
35 
21 



5 
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MICROCOPY RESOLUTION TEST CHART 

NATIONAL BUREAU OF STANDARDS 

STANDARD RE EERENCE -MATERIAL iOlOa 
(ANSI and ISO TEST CHART No 2) 
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QJ 



4j 
C 
Qj 

* _ 
C 

Of * 

4J 
Xt 



C 

Qj 

0 



c 



O 
C 



Q> 

CO 



4) 
CO 



at 

«--v 



O 

o 



O 



C. 



d. 



Within your pay pool, to what, extent, if 
any, wer& standards set and ratings and 
payoute made without favoritism? 

Agriculture 

HUD 

Navy 

To what extent, if any, were your pei>- 
formance standards reasonable and 
capable of being exceeded by outstanding 
performance^ 

Agriculture 

HUD 

Navy 

In your office/division, to what extent, 
if any, were merit pay employees 
^equitably relative to nonmerit pay 
enployees? 



-percent- 



10 


18 


17 


14 


9 


33 


4 


13 


16 


16 


14 


34 


11 


22 


N 16 


15 


11 


26 



4 


19 


37 


18 


11 


19 


3 


17 


29 


21 


21 


6 


6 


32 


35 


14 


7 


4 



HUD 



8 


26 


14 


9 


16 


33 


5 


18 


18 


14 


18 


26 


12 


27 


12 


7 


10 


32 
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18. Below aire ^r>n*i ^ • ^ > * 

problem," » A moderate problem " "2Li ^ 9reat P ro blem," " A great 
£°if£f "Wd not happSn tS me," ^SS'ft" P^" 1 '" "Littl/or no 
describes your experieTuk Don t- know/Not sure," whichever best 



to z? £■ ai 

£ f $ 3 * £ 

4? ^ *» i ^ 5 

P * to g „, +> £ 



H y popi as subordinates. 



-percent— 
9 6 

12 8 9 8 



Agriculture ID 7 q s „ a „ 
HUD o 9 ? 23 20 25 



*■* « *S If « « | 

a^dlSnSrds^I 6 ^ **** °^^nts 
<*xi as for 016 ^ame or similar jobs 



Agriculture 7 12 17 q o„ ,„ 

HUD o {• -J 24 12 18 

Navy ,7- ' J 10 31 12 16 

* 17 15 14 9 21 10 14 



°' £5 of written justifications for vour 
Performance rating.- y ar 



Agriculture 7 8 12 11 38 ,2 3 



fi^i!^™--^^er than 



13 12 9 8 33 20 5 
8 9 10 10 39 



19 



Navy 

evi ewers, hi 

manager.. 

Agriculture 8 3 r c . - ■■■■ 
HTTn . ,Z. i 5 5 17 49 



HUD 19 8 I a V 49 1? 

Navy * if ? I I 13 35 14 

,J 7 8 6 18 36 11 



78 



98 
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e. Inconsistencies in how_raters within the 
same pool judge performance. 



Agriculture 

HUD 

Navy 



f. Subjectivity in ratings. 



Agriculture 

HUD 

Navy 



g. Lack of a decision rule or guidelines f or 
combining ratings on separate elements 
into one overall rating. 



* HUD 
Navy 

h. Amount of money available for merit pay 
increases. 

Agriculture 

HUD 

Navy - 



0) 



■O 
O 

0, 



ftf 



O 



o 

A 



1 
O 



O 



O 



C0 



4/ 



^O 



o * yi 

to - O 



43 
C 

o 



t 



c 

Q 



Q) O 
XT 



O*. 







— percent- 








24 


19 


12 


9 


10 


8 


18 


30 


29 


10 


8 1 


7 


7 


19 


27 


16 


1,1 


10 


10 


7 


18 


21 


18 


15 


14 


14 


4 


12 


29 


20 


15 


10 


10 


4 


11 


23 


.20 


13 


12 


14 


5 


12 


6 


6 


9 


10 


33 


17 


19 


9 


8 


16 


10 


30 


10 


17 


10 


12 


14 


11 


27 


.10 


16 


23 


13 


12 


10 


17 


3 


23 


20 


16 


11 


8 


19 


2 


23 


30 


17 


12 


7 


14 


2 


18 



-J 



1 h 
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19. For each of the following questions , please indicate the extent of your 

feelings by checking "To a very great extent," "To a great extent," "To sore 
extent," "To a little extent," "Not at all," or "Don't know/Sot sure." 



4J ±J 

c * c 
* * if 

XT W 

4J _<t> _ O 

itS -4J +■> C , 4J 

Q> C — O 

* CT) ^ ^ 

O w 



^ «? S ^ 



4J 

O O J? JP .o 



a. Tt> what extent, if any, were you 

satisfied with the amount of input you v : 

had in setting yoctr FY 1982 performance " - -perc^it-— — 

standards? _ „ ' 

'T Agriculture 14 37 ,24 11 12 1 

HUD 7 22 27 14 28 3 

J Navy 16 36 26 8 13 1 

b. Realizing that you may be motivated I by ;__a 

frtfntber of factors, such as type of work, 4 
personal goals, etc, to what extent, if 
any, does money help to motivate your 
job performance? " ~ '/ 



6 14 ; -37 24 17, 1 _ 
HUD 9 14 ^ 38 20 18 1 C 

Navy 8 15 37 22 16^ 1 

^ 

c. Tb what extent, if any, did the amount 
of nfer i t pay g i ven th i s year to your pay 
pool's top performers help to motivate 
you to outstanding performance? 

Agriculture 0 3 9 14 65 8 
i HUD 1 2 9 16 68 4 

13 10-17 65 3 
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20. Since the merit pay/performance appraisal systems were instituted, haye_ 

performance ratings become ipore subjective, less Subjective, or remained at . 
the ^ame level of subjectivity as before? 




Agriculture 



HUD 



Navy 



f — (percent) - 



„ riSfejreat deal more subjective 
Somewhat more subjective 

Remained at the same level of subjectivity 

Somewhat less subjective 

A great deal less subjective j 

21. Has connunication between you and your supervisor gotten better, worse, or 

remained about the same since the performance appraisal/merit pay systems were 
instituted? / 



9 




12 


19 


26 


21 


id 


37 


46 


16 


10 


16 


6 


4 


4 



Agriculture HUD Navy 



(percent)- 



A lot better 


2 


1 


4 


v > Somewhat better 


- 8 


8 


13 


* Remained the same 


79 


- 73 


70 


Somewhat-worse 


6 


11 


8 


A lot worse 


5 


' 6 


5 
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22. These next questions ask abbut_scme additional aspects of the ^rfbintahce 

appraisal/merit pay systems • Please check the one ; box which best answers each 
question. 



0 



in O 
" O 



;C* J° S ^ 

vac ,a *v 
a o X <z/ 



a; fts yod understand the definition of management 
official and supervisor, do you believe you 

should be tinder Jthe merit pay system? percent- 



35 28 7 15 16 
HUD 45 25 5 12 13 

38 25 5 13 20 



b. In general, can the. productivity of jobs 
like yours be accurately measured? 

Agriculture 11 30 7 40 12 

HUD 12 36 1 33 . 12 

Navy ^ 6 25 8 46 ' 21 

c. Did management employ a forced distribution 
or quota system in developing the ratings 
for your pool in FY 1982? 

Agriculture 14 16 48 8 13 

HUD 36 23 31 7 4 

Navy 24 19 40 6 11 

d. Was the immediate supervisor who gave you 

your recomrended performance rating* in the - 
same merit pay pool as you? 

Agriculture 43 8 9 4-36 

HUD 56 13 13 2 16 

63 6 6 1 24 

Was merit pay fairer in Ti 1982- than in 
FY 1981? 

Agriculture 5 15 . 58 22 19 

HUD 4 17 26 24 30 

Navy 7 15 36 23 18 
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23, Did you fill out a GfiD questionnaire on the merit pay system last year? (It 
may have -been part of a survey conducted by your agency.) 

Agricult ure HUD Navy. 



• (per cent) - 



Yes 58 52 18 

No 24 28 65 

Not sure 19 19 17 

24. Please make any narrative comments you wish to concerning the performance 
appraisal/merit pay systems in yopr agency. Your comments are anonymotfe. 

. Agriculture HUB Navy 

(percent) 

No comments . 29 36 28 

Comments / 71 64 72 

The following questions were alkted in 1981 only. 

Did you get enough training in each of the following areas to allow you to 
accurately and fairly perform the function? • 

• - - ; • / 

<0 O ' o 

* # f c 

*p *p «3 

. O . -J* -o -Sr . 

^ & ^ j& 
<5 *K ^ <S 



■(percent)- 



a.^set performance standards? 



• Navy 


24 


47 


7 


11 


12 




Agriculture 


23 


48 


8 • 


14 


8 




HUD 


15 


43 


8 


18 


17 


b. prepare performance ratings? 














Navy 


23 


45 


11 


11 


10 




Agriculture 


* 22 


48 


9 


13 


8 




HUD 


16 


45 


8 


17 


15 





83 - 

103 • 

ERIC 



APPENDIX * I II 



APPENDIX III 



Of 

4 / - 

-lb A> R 

C D" IF 

*?< & & if V 

.« r_ <f _ <r <r <f 



o 



o 



8/ 



c. counsel subordinates? 



-percent- 



Agriculture 
HUD 



19 
18 
15 



39 
43 
43 



16 14 
15 - 15 
9 18 



12 
10 
15 



i (I.e. , GM level) 


on October 4, 


1981? 






; 

Navy 


Agriculture 


HOD 










GM-1 3 


58 


-(percent) 

':. 58 


43 


GM-14 


29 


29 


31 










GM-V5 


13 


^13 


26 
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TOP PERFORMERS, 1 RE SPONSES 

' ^ — — ~f — — ■ , 

* - . 

TO 1982 QUESTIONNAIRE . " 

> The following shows how top-rated ^ach Depart- 

ment answered selected questions from the 1982 GAO question- , 
naire. fop-rated perf ormers are those in our resjiondept group 
who received a Level 1 rating in Navy^ an .Outstanding rating in 
HUD - f or 4.5 or better in Agriculture for" fiscal year 1982. 



QUESTION 



.8) 
2 



A 



<J 
O 



/ 



o 



A 



4? 



J 



-percent- 



Has merit pay motivated you 
to better performance? 



Have you become more pro- 
ductive as a result of rjprit 
pay? 

Did the amount of merit pay 
you earned for your per- 
formance in 1982 accurately 
r ?fl§?^_ t ^? quality of your 
per ^>rma rice? 



Should the performance 
appraisal system instituted 
under* merit pay be retained 
even if it? is not tied to 
merit pay? 

Under^merit pay, do you feedr" 
more pressure to fulfill the 
duties and responsibilities 
of your job than you did 
prior to merit pay? 















Agriculture 


3 


20 


>-2 


34 


*41 


HUD 


6 


24 


• 9 


32 


29 


Navy .__ 


8 


27 


3 


20 


42 


& ' 

Agriculture 


5 


7 


'10 


36 


42 


HUD 


5 




1 1 


42 


35 


Navy ^ 


5 


18 


12 


21 


44 


Agriculture 


7 


29 


16 


12 


36 


HUD 


23 


33 


. 8 


13 


23 


Navy 


18 


' 30 


9 


9 


33 



Agriculture 
HUD/ -. s 
Navy 



Agriculture 

HUD* 

Na\?y 



8 



0 
5 
9 



35 
42 
26 



14 
24 
18 



1 1 
14 
14 



7 
6 
9 



16 
17 
15 



25 
.18 
18 



25 
23 
37 



54 
47 
45 
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Agriculture HUD 
percent — 



Navy 



wnicn or trie toixowing wouia 
you most ^prefer? ,( check one) 








Retain merit pay system as it is 


9 


14 


13 


Retain pay bat's ed on merit but revise 
system rrom wnat it is now 




•47 


, / 42 


Return* to the bid GS system to 
determine pay ; 


42 


2? 


34 


Other 


13 


11 


11 


In general, how fair .was the performance 
appraisai/nier it ,pay sysoeni ^.ta&t year. 
( FY* 1982) 




' \ 




Very fair 

V 


'8 


13- 


24 


Fair > 


39 


►* 41 


37 


Neither fair nor unfair 


19 


M 


18 


Unfair 


24 


22 • 


15 


Very unfair 


10 


16 


6 


- " " - " s - 

Including comparability ana merit/ pay, 
wnat was tne mimniax pay increcra»-uveL 
your FY 1982 salary, if any, that would 
nave motxvat-ea y t - )a oclccl ( 
performance this year? 








>4 percent or less 


0 


0 


0 


j 

4.1 to 6 percent 


3 


5 


3 


6.1 to 8 percent 


5 


8 


. 1 1 


8.1 to 10 percent 


14 


9 


10 


More than 10 percent 


19 


19 


29 


Don't knovJ/not sure 


15 


14 


1 1 


Money does not motivate me to 
better performance 


44 


45 


35 
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Agrical tare HUD 



Navy 



Since the merit' pay/performance _ ■ 
apPF&JLsal systems were instituted ^ 
have performance ratings become 
more subjective, less subjective , 
or remained at the same level of 
subjectivity as before? 



A great deal more subjective 

Somewhat more subjective . 

Remained at the same levej of 
subjectivity 

Somewhat less subjective 

A great deal less subjective ' 



-percent- 



10 
26 

45 
10 
9 



13 

22 

41 
19 
6 



1 1 
1 1 

19 
13 
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' POOLS AND RATINGS REVIEWED 

The following table shows the number of ■ pools -we reviewed ^ in 
1 98 1 and 1982^ the number of pools and merit pay employees in the 
three Departments, arid the number of employees included in the 
pools we reviewed. . 

... Summary of- Merit Pay ^JPooite - 

and Ratings Reviewed for Both Reviews \ 

HUD _ 



Navy 
1981 198 2 



Total merit pay 
pools in 
Departments 



500 



565 



1981 



21 



1982 



Agriculture 
1981 1982 



Total 



1984 1 982 



20 



333 



351 



854 



936 



<Total poQls 




28 


24 


19 


1 1 


37 


22 


84. 

i 


57 


reviewed 




















Headquarters 

* . . *. . 




12 


13 


9 


9 


30 


15 


51 


k 37. 


Field 




16 

« 


1 1 


10 


2 


7 


7 


' .33 


20 


Total approxi- 




















mate number 














f 






of- employees 




















under merit 
pay 


16, 


. 100 


16,000 


2,200 2,200 


9,600 


9,500 


27,900 


27»70O 


Total number 




















.of employees 




















covered , in 


















3,821 


pool s re vi ewed 


2", 


.219 


2,085 


1 ,973 


888 


1 ,366 


848 


5,552 


Total- number of 




















ratings 
reviewed 




149 


1.49 


163 


163 


163 


1^3 


•475 


, 475 



\ For the second-year review our Boston Regional Office staff 
reviewed six pools not studied the first year. Also* to expedite 
our work, in the second year we deleted several pools in each. De- 
partment that we reviewed the first year. The result- was that, <^f 
the 57 pools reviewed in the second year, 50 (88 percent) were also 
reviewed- in the* first year. 
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CONTENT ANALYST^ PERFORMANCE , 

. APPRAISALS AND STANDARDS 

Content analysis is a procedure for collect ing and organiz- 
ing information in a standardized format which allows analysts to 
make inferences about .the characteristics *and meaning of written 
material. The objective bf bur content analysis was to assess 
the quality of performance standards during fiscal years 1 98 1 1 and 
1982 in the pools we examined at the Departments of Agriculture, 
HUD, and Navy, 

_1Q assessing the quality of performance standards, we used 
OPM 1 s characteristics of good performance standards. For ea<^' 
standard, we determined whether it 

: — contained quality measures — identified how good or how 
accurate performance must be ; 

— contained quantity measures — stated how much work or how 
many items are required ; 

— contained timeliness measures — indicated how soon or when 
tasks should be completed; 

— distinguished performance levels — differentiated between 
Outstanding and Highly Satisfactory (or next lowest 
level), Satisfactory from Marginally Satisfactory (or next 
lowest level ) , etc.; 

--contained measures below the highest level that could be 
exceeded—had measures below outstanding that could be 
surpassed rather than being set at the level of perfec- 
tion; and 

— identified unacceptable performance — had measures that 

clearly and realistically described unacceptable 
" performance; 

We limited bur analysis to standards from employees in pay 
pobls reviewed in each agency in our second-year evaluation. .' 
(See app. V.) Within each pool/ we randomly selected a sample of 
.employees wha were in the pool in both fiscal years 1981 and 
1982 t and we analyzed their performance standards from both 
years; The selection procedure and sample sizes were designed to 
allow for a high level of precision and confidence in projecting 
our findings to jill performance standards_iri the pools we exam- 
ined and in comparing results from the 2 fiscal years. The num- 
ber and size of the pools from which our samples were selected 
and sample sizes are- presented in the table below. 
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Universe and Sample Sizes 

_ Universe Sample 



Number of 
pools 3 

Agency 

HUD__ 
; FY 81 
FY 8^5 

Agriculture 

FY 81 18 
FY 82 

Navy 

FY 8 1 19 
FY 82 

a Number of pools is 



Employ- Stand- 
ees a+ ^ ards^ 



Employ- Stand a rds 



161 ' 1,079 

155 2,387 



11 795 5,000 

12,000 



618 9,000 163 2,286 

12,000 162 3,039 



1 ,377 . 16, 000 137 1 ,576 

16,000 138 1 , 662 

y 

the same for fiscal years 1981 and 1982 



^Universe size is the total number of employees in the 
pools we examined: who were in the same pool in fiscal years 
1981 and 1982. In most cases, size was estimated from 
total pool size in the 2 fiscal years. 

c Univer se of standards is an estimate of total number of 
standards in the pools examined. It equals (the number , 
of standards in the sample divided by number of employees 
in the sample) multiplied by total number of employees who 
were in the pools in both fiscal years (i.e., universe 
size ) . - 

^Sample sizes vary between years because of incomplete data 

on some- employees 

■ : : : ^ \ ' ' 

Content /analyses require that one person initially analyze 
the standards and that a second person repeat the analysis ^inde- 
pendent from the first person, on at least a subset of stand- 
ards. This_will determine the reliability of the initial 
analysis. Reliability can be expressed as the agreement between 
the two independent analysts on at least 80 percent. or more of 
the standards. On a 10-percent random sample of all standards 
analyzed, the two raters agreed on from 83 percent to 90 percent 
of their judgments on each of the six dimensions outlined above. 

The 95-percent confidence level for fiscal years. 1981 and 
1982 performance; standards in the pools examined in -each of the 
three Departments was ±5 percentage points at most. 
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. . • • r. 

Assuming our sample of employees represents their fellow merit 
pay pool members, the confidence intervals indicated the preci- 
sion with which our findings reflect what would have been ob- 
tained had we analyzed all performance standards iri_ the pools 
examined. For example, if 50 percent of the _ Agriculture 1 98 1 
performance standards analyzed contained quality measures, then 
we can say that we are 95-percent sutfe that between 45 percent 
and 55 percent df- all _ 1 98 1 . standards in the Agriculture pools - 
sampled contain a quality measure. 
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PERCENTAGE DISTRIBUTION tiF R ATINGS BY GRADE 



NAVY' 



Percent 



60 
50 . 
40 - 

3tr 

20 - 

10 - 



Grade 



P«rc«nt of 
ratings in 
—ch category 



LEVEL 1 



13 14 15 



1981 5 

1982 9 



8 

14 



15 

23 



LEVEL 2 



LEVEL 3 



13 14 15 



13 14 15 



25 33 35 
31 36 38 



HUD 




LEGEND: 



1981 
1982 



LEVEL 4 



13 14 15 



13 8 



Percent 



60 : 
50 . 

40 . 
30 _ 
20 . 



10 . 



Grade 



HIGHLY 

SATISFACTORY 



FULLY 
SATISFACTORY 



OUTSTANDING 



13 14 15 



13 14 15 



13 -14 15 



P.rc.ntof 8 9 24 46 54 48 

ratings in ' - . 

reheat W ry 1$82 5 8 19 41 42 42 



52 47 37 



LEGEND: 



1981 
1982 
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Percent 



60 

5b _ 

40 - 
30 . 
20 
10 _ 



Grade 



4.4-4:0 



5.0-4.5 



3.9-3.5 



13 14 15 



13 14 15 



13 ' 14 15 



Percent of jgg-j n 13 20 
ratings in - - . 

eech category 1982 10 *3 22 



33 39 43 
38 46 46 



38 35 29 
41 33 27 



LEGEND: 



1981 
1982 



3.4--3.0 



13 14 15 



17 12 7 
11 .7 4 
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A VERAGE? MERIT PAY INCREASE^ BY PERFORMANCE LEVEL AND GRADE 



Dollars 



$4000 
$3500 
$3000 . 
$2500 ; 
$2000 ■ 

$1500 : 

. $1000 . 
$500. 

» o_ 

Grade 
Amounts 



NAVY 



LEGEND: 



LEVEL 1 



1981 L 

1982 r 



LEVEL 2 



LEVELS 



LEVEL 4 



13 14 15 



^3 14 15 



13 14 15 



13 14 15 



Rounded 1981 ' $160 o $1900 $2200 $800 $900 $1100 $300 $300 $400 

1982 $2300 $2700 $3200 $1 800 $2200 $2600 ^1400 $1 700 $2000 - $1100 $1300 $1500 



t Dollars 



$4000 



/ 

$3500 _ 

$3000 _ 

$2500 _ 

A. 



$2000 _ 
$1500 _ 
$1000 
$500 _ 
0 



Grade 
Amounts 
Rounded 



HUD 



OUTSTANDING 



13 14 15 



HIGHLY 
SATISFACTORY 



FULLY 
SATISFACTORY 



13 -14 15 



13 14 15 



1981 $1200 $1300 $1500 $600 $700 $900 

1982 $3100 $3400 $4000 $2000 $2300 $2800' $100051000 $1300 



LEGEND: 



1981 L 

1982 r 



-r 
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Dollars 

v 



$4000 



$3600 - 
$3000 
$2500 - 
" J $2000 " 
$1500 . 
$1000 _ 
$600 - 
0 



5.0-4.5 



AGRICULTURE 



Gradg 
Amounts 
Rounded 



13 14 15 



4.'4-r4.0 



3.9-3.5 



LEGEND 

1981 < ' 

1982 C 



J 



3.4- 3JL 



13 14 15 



13 1* 15 



13 14 15 



1981 $400 $500 $600 $400 $400 $500 

' 1982 $1700 $2000 $2400 $1600 $1900 $2200 



$300 $400 $500 
$1400 $1600 $1900 



$300 $300 $400 
$1000$1100$1500 
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AN EXAMPLE OF MERIT PAY CALCULATIONS 

gETERMINING_MgNEY_ AVAILABLE 

FOR MERIT INCREASES v _- . 

/_ The following step-by-step ^^mple of how merit pay i s _^e- 
te if mined is based on the Nstvy's pSeedures . Calculating merit 
pay in another agency withta (Hfferent .formula could be very 
dijfferent from the example^Jiere , a s\ discussed in chapter 2. _ 
However, this example does show two N^teps required in any calcu- 
lation: determining the money available to make merit increases 
and the individual merit increases^. 

Agency .officials alldcate^furids to ' the pool ' s merit pay ' ■_ 
fund using figures and procedures' provided by OPM. Step 1 : The 
percentage of all pool members ' salaries available for distribu- 
tion as merit pay increases is calculated- This percentage is 
the sum .of one-hal f- the ^co mparability incre ase to be granted in 
t^ie year plus the percentage of salaries normally available for 
wi thin-grade increases and quality- step increases for the year, 
(For this example,* the comparability increase is 4.8 percent. 
Half of this is 2.4 percent. We are also using a wi thiri-grade_ 
and quality step figure of 1.2 percent for everyone in the pool, 
although this figure normally varies, depending on a person ' s 

location in the salary range.) The resultant sum is :Ttf24 + 

.012 = .036%. Step 2; For each grade, the salary of each posi- 
tion in the grade is multiplied by the percentage found in 
step 1. These figures are then mul t ipl ied I by the number of pool 
members in each position in the grade. (For this example, an 
average salary has been used for each grade;) Finally, the 
totals fqr each v grade are added together . This number is the 
pool's merit pay fundi 

The merit pay fund for a hypothetical employee, Jane Doe, 
was determined using the following data. The pool has the fol- 



lowing grade distribution. / 

Grade * Number 

GM-13 16 
GM-14 11 
GM- 15 3 



The average salary for each grade in the pool is: 
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\ ' Grade Average sa l ary 

" ■ y 

~GM-13 $32,312 
f GM-14 38,184 

GM-15 44,915 

» _ _ 

The merit pay^fund for Jane * s pool is calculated to be $38,584, 
using the table shown below. 

Sum' of comparability 
Average X increase arid annualized X Number 
Grade salary . ' step and QSI in gr a de = Total 

13 ji $32,312 .036 16 $18,612 

14 v 38,184 .036 11 15,121 

15 44,915 .036 ' 3 4,851 

Total merit pay fund $T8 , 584 

r—~ ^ '- - — 



DETERMINING INDIVIDUAL 
MERIT INCREASES 

Using the allocated funds, a reviewing official calculates 
individual merit pay according to the following procedures: 

\ _ 
— Assign merit pay points for individual performance. 

— Determine total grade-adjusted merit pay points. 

— Determine dollar value of each merit pay point. 

--Calculate individual salary increases. 

Assigning megi t pay po i nt s 

for in dividual performan ce * 

Merit pay points are assigned to each pool member according 
to his or her rating.. Assuming that this 30-member pool has a 
normal distribution of ratings, the people in each performance 
category, and the points assigned to their ratings woald be as 
follows: " H 
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Performance category 



Level 1 



Level 2 

Level 3: 

Level 4; 

Level 5: 
Level 6: 



Substantially exceeded all 
objectives 

Substantially above target — 
most significant objectives 



Number in ' 
category 

2 

* 3 



Above target — most signifi- 
cant objectives 

On target — all significant 
objectives 

On target — some objectives 

B^iow target — one or more 
critical elements 



17 



Point 
value 



2. 1 

1.7 

1.3 

1.0 
0.7 



1 



Jane Doe , whose performance category is Bevel 2 , receives 
1.7 points. ""i* 



Determining grade-adjusted 
merit pay points \ 



Next, th? pogl^s total merit pay points are calculated • At 
this pointy the level of job responsibPiity reflected in the em- 
ployee ^s grade level enters the merit pay calculation . iD^ividT 
ual merit pay points are now adjusted by a salary differential. 
The following salary differentials are used in this example: 



Grade 

GM-13 
GM-14 
GM- 1 5 



Salary differential 

1 .66 
1.18 
1 .39 



'For each grade, the total merit pay points are multiplied 
by a salary differential. These totals are. added to calculate 
the total grade-adjusted merit pay points earned by the pool 
members 

Jane ■ s pool has 16 GM- 1 3 ' s , who are distributed among the 6 
performance categories, as shown on the following chart . By 
multiplying the number of GM-Jj 3^s in each performance category 
by the associated merit pay points, the total points earned by 
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GM-13's in the pool are calculated . {Jane's performance cate- 
gory is asterisked.) 

y Number Point GM- 13 

Performance category of GM-13's value points 

Substantially exceeded . i _ 

all objectives 1 X 2*1 - • 2 • 1 

- , 4 

Substantially above target — , - - * 

most significant objectives** 1 X 1.7 85 1-7 

Above target — most significant 

objectives ~~ ' 3 X 1.3 = 3 . 9 

' >- 

On target— *11 significant * L * i n M Q U 

objectives 9 X 1.0 9.U 

On target—some objectives 1 X .7 = .7 

Below target — one or more _ 

critical elements 1 X 0 = 0%0 

Total GM-13 points = 17.4 

To find the GM-13 grade-adjusted points, the total GM-13 points 
(17.4) are multiplied by" the salary differential (1.0). 

• . » . _ . - . _ 

The total grade-adjusted OM-14 and GM-15 points- are calcu- 
lated in the same manner. By adding the three grade-adjusted^ 
totals, the total' gS'ade-ad justed points earned by. the members of 
the pool is as follows: 

Grade-adjusted GM-13 points =17.4 

Grade-adjusted GM>14 points =15.34 

Grade-adjusted GM-15 points = 6.12 

Total grade-adjusted points = 38.86 

7 • 

f 

■ / ■' . l. = 

99 - 

* 119 ■ * 
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Determining dollar value of 

each merp,t pay point - ' 

- - - - __ J'j ' _ _ J 

Jarie # Doe's pool earned_38.86 points; fhe'ambunt of mcmey 
in the pool ' s merit pay fund, $38> 584 is divided by 38.86 to 
determine the' dollar value of a point. The dollar value of ay 
point in Jane 1 s pool is $993/ 

salary 5 i^crls^ase 1 ' i •_ ^ 

^ ' " * ' ~ 

Knowing the dollar value of a point, as well as the^number 
pf points earned by each pool member, the individual salary In- 
creases of _eacb member irithe pool are calculated. This is done 
using the following formulas ^ 

- — _-- . _ ' < * / S "> 

— For .GM-13 : Points earned x 1._0 (salary differential J x 

dollar value of a point = merit pay increase. 

— 'Points earned x 1.18 (salary differential) x 
dollar value of- a point ='merit pay increase. 

— For GM-15: Pointy earned x 1.39 (salary differential ) x 
dollar value of a point = merit pay increased 

- *■ - 

Jane poe , whose performance category is "substantially 
above target — most significant objectives" earned t.7 points. 
Since she is a GM-13, her' salary differential factor is 1.0. 
Jane's merit pay increase is calculated in the following manner : 

Points earned ....................................... 1.7 

x Salary differential . . .............................. . x 1 . 0 



x Dollar value of point ; . . I ; ..... . ..... ; . ............. . x _SL9S 

Merit pay increase • L • t V .$1,688 



To calculate Jane's total salary increase, one must add the- 

other half 6f comparability, 2 .4 percent of salary in this exam- 
ple, to her merit pay increase. Thus, Jane's total salary in- 
crease £ari be* computed as follows: '■••«. 
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Jane's current salary............. 

x percentage comparability increase, 
Comparability increase. ..... ... . . . 



Comparability increase 

+ Herit pay increase.......... 

Jane's total salary increase 



$33*291 
x, .024 
$ 799 

$ 79*9 
+ 1 ,688 
$ 2*487 
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CALCULATIONS OF PERFORMANCE APPRAISAL 

FUNCTION S C OSTS IN FISCAL YEARS 

1980, 1981, AND 1982 

Estimates of fiscal years 1 980-82 costs fpr performance ap- 
praisal functions in HUD V Agriculture, arid the N^vy were based on 
ques tibnriaire responses concerning time spent on supervision and 
on developing performance standards. In bur first-year question- 
naire , supervisory employees indicated the average number of 
hours spent in setting subordinates ' performance standard^, com- 
pleting the rating , and counseling the merit pay employees they 
direct^/ supervised I in fiscal year 1 98.1~the "first year of merit 
pay . /^Respondents who supervi sed GM- 1 3 , s GM-r\4 , or GM-15 employees 
in fiscal year 1980 also indicated the average hours spent on 
performing the qame supervisory functions in fiscal year 1980 — 
the year before me£it pay began. .The questionnaire also asked 
all employees to estimate the number of hours spent developing 
their own performance standards arid being counseled about their 
performance in fiscal years 1980 and 1981. 

In the second-year questionnaire/ merit pay employees indi- 
cated average hours s|>ent on^ supervisory functions, setting their 
own standards, and being counselled in fiscal years 1981 and 
1982. For all questionsof time, respondents indicated their L 
answers by checking one of the following response -categories : 
none; 1 to 8 hours; 9 to 16 hours; 17 to 24 hours; or 25 hours or 
more . 

To estimate costs, it was necessary to assign numerical 
values to respondents 1 answers which ( 1 ) would approximate the 
number of hours ^indicated/ by their answers and (2) could be sub- 
jected meaningfully to arithmetic operations. The responses were 
assigned the midpoint of th^ category in which they feil^ as 
follows : 

Category Assigned value 

None = 0 hours 

1 to 8 hours = 4.5- hours 

9 to 16 hours * 12.5 hours 

17 to 24 hours , = . 20.5 hours 
25 or more hours = 28. 5 hours , 
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This conversion of 'data assumes that* in each category , the 1 
actual number of hours respondents spent are evenly distributed 
so that their average is the category midpoint, 

* The following basic formula was use^ to calculate the costs, 
of performance appraisal functions in each agency for each fiscal 
year : . : * 

; Costs = ((X super + X own) x wage) N . 
r- where 

X super a the average number of hours spent on supervisory 
functions per merit pay employee as indicated by 
the supervisors sampled 

X own = the average number of hours per employee spent bri 
developing own standards arid being counseled by 
supervisors 

W age = in each agency , the average .hourly salary of GS-13 
through GS-15 employees in fiscal year 1980 

. n = population size (i*e., total merit pay employees 

for fiscal years 1j981 and 1982; for fiscal year 
1980, the number of IGS-13's through GS-JJ5 ' s con- 
verted to merit pay in fiscal year 1981 which is 
equal to the number of merit pay employees in fis- 
cal year 1981 ) ' * 

Fiscal year 1980 and 1981 costs were estimated based on <3ata 
.from our first questionnaire ,__and costs in fiscal year_ 1 982 were 
calculated using data from bur second questionnaire . Data from 
both questionnaires was available for use in estimating fiscal 
year 1981 costs. .Data obtairiedin the first year was collected 
closer in time to fiscal year 1981 than in the second year (i.e., 
3 months after the close of the fiscal year .as opposed to 1 year 
and 3 months). Findings from our first questionnaire were 
thought to be more valid measures of time spent dn fiscalyear 
1981 arid, therefore, were used to estimate fiscal year 1981 
costs. < * . 

Because of the timing of our questionnaires arid our decision 
to base fiscal ye^r 1981 estimates bri first-year data., fiscal 
year 1981 and 1982 cost estimates are based on data collected 
only 3 months after the end of the respective fiscal years while 
fiscal year 1980 estimates are based on data collected about 1 
year and 3 months after the fiscal year's close. This Matter- 
estimate, therefore, may be more prone to the. types <p£. recall 
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errors that occur with the passage of time than the fiscal year 
1981 and 1982 estimates. Also; since errors of omission and 
telescoping would lead to more and more underestimation as time 
passed , comparisons between fiscal year 1980 and the. other .years 
might indicate greater increases in costs than actually occurred. 

, t. 

To eliminate the possible effects of the extended recall 
period on our fiscal year 1 980 estimates and on comparisons 
between years, findings from both years on time spent in fiscal 
y e ??" 1981 ^§ r ?_y s ?^_ estimate the increase in recall errors oc- 
curring with the addition of a year to the recall period . Our 
estimate of time spent In fiscal year 1980 was then adjusted by 
this estimated increase in recall error. As expected, fi? c ?l 
year J981 time estimates from the second-year ' s questionnaire 
were lower than the initial survey estimates in all three Depart- 
ments . In the f ollowup questionnaire , employees ' _ reports of time 
spent on performance appraisal functions in fiscal year 1981 were 
16, _33j and 22 percent below the time estimates 1 year earlier in 
Navy, HUD, ^nd Agriculture , respectively. Fiscal year 1980 time 
estimates were adjusted upwards by the respective percentage in 
each agency to compensate for the estimated increase in recall 
error.' The formula used to estimate fiscal year 1980 costs,, 
therefore , was as follows: 

Cpsts (FY 1980) = [{X super + X own) + E (X super + X own) x 
- wage] N 

where^ _ 

E = the. average fiscal year 198 1^ time reported in the ini- 
: tiai. survey minus the average fiscal year 1981 _ time re- 
ported in the second questionnaire as a percentage of 
the initial survey 1 s average time 



Ad j usting our estimates by' the total percentage assumes that 
dif f ererices_betweeri the initial am followup findings for fis- 
cal year 1981 occurred solely as a function of recall error as 
opposed to recall error in combination with other factors,, ' such 
as random sample variation x>r differences between the t#b. 
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DEPARTMENT OF AGRICULTURE 



OFnCE OF ASSISTANT SECRETARY FOR ADMIN 1ST RAT ION 
WASHINGTON DC 20250 



SUBJECT: GAD Draft. Report Entitled "A 2-Year Appraisal, of Merit Pay 
' in Three Agencies" ) 



TO: 



J. Dexter, Peach, Director _ 
Resources, Carrnunity, and Economic 
Development Division, GAD 




The following corment is provided on the subject report. The charts 
which aopear in Appendix VIII (pages 94 and 95) depict average merit pay 
increases by performance level and grade. Average merit increases are 
shown in dollar amounts. 

While these charts are technically correct, they create the false inpression 
that unfair .benefits are accruing to those at the higher grades. In fact, 
'because higher graded individuals have higher base salaries, they contribute 
proportionately more to the pay pool and receive greater increases. TO, 
present an unbiased view of merit increases across grade levels, the 
percentage of 'increase over base salary must be used. An essentially level 
distribution is achieved when the Agriculture chart on page 95 is converted 
to percentage increases. m ■ - 




I 



JOHN 

Assi/tant Secretary for 
Lstration 



GAO note: 



Page references have been changed to correspond with 
pagination in the final report. 
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MANPOWER 
RESERVE AFFAiRS 
AND COGiSTICS 



ASSISTANT SECRETARY OF DEFENSE 

WASHINGTON DC ^0)01 



Mr. Frank C. Conahan 

Director, National Security and 

, Intergovernmental Affairs Division 
U.S. General Accounting Office 
Washington, D.C. - 205U8 

Dear Mr. Conahan: 

This is the Department of Defense response to your Draft Report, 
"A_2-year Appraisal of Merit Pay in Three Agencies," dated October 6, 
1983 (GAD- Case No.. 96613d; OSD Case No. 63?U). 

The Department considers .the draft to be an excellent report. The 

.recommendations proposed are ones with" which this Department concurs. 
The specific findings and recommendations contained in the draft report 
are addressed in the attachment. 

The opportunity to review and comment on the draft report is* 
appreciated. 



Sincerely, 




Attachment 



Jerry L. Calhoun 
Principal Deputy A-rsJctr^t ^ 

(Manpower, Reserve Ai.-V- '<~ 



SAO note: Page references have Been changed to correspond with 
pagination in the final report. 
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DoD Response on GAO Draft Report, "ft 2-yeat Appraisal of Merit 
Pay In Three Agencies," dated October 6, 1983, GAO Case No. 
966130; OSD Case No. 6374 



FINDINGS 



FINDING A; Several Factors Other Tha n Performance Have 
Af fected Merit Pay . GAO found that several other factors, 
independent of performance, have affected the size of merit pay 
increases at Agriculture, HUD and Navy. These included (1) the 

accuracy of the performance standards and ratings, (2) 

distribution of ratings within a merit pay pool," (3) composition 
of a merit "pay pool, and (4) agency formulas for computing merit 
pay increases. GAO further found that when headquarters and 
field or noncareer and career employees are included m the same 
pool, employees may feel they are competing in an unfair 
environment and that their merit pay increases may not reflect 
performance. For example, in HUD and Navy, a headquarters merit 
pay employee was more likely to receive the highest rating than 
an employee in the region/field. GAO concluded that, because of 
employee concerns over the equity of merit pay, Office ot 



concluded that OPM' can help accomplish increased acceptance 
by reemphasizing the need for Schedule C and career employees to 
be placed in separate pools and by enforcing OPM regulations 
which prohibit the forced distribution of ratings. GAO finally 
concluded that the agencies can help reduce the effect ot . 
nonperformance factors" by considering such. factors as pool size 
and employee grade and responsibilities in establishing merit pay 
pools . (pp. 6-24, GAO Report) - • 

The Department of Defense concurs with this finding. 

FINDING B: Performance Standards Are Better, But They Still Need 
Improving,. GAO found that, although the quality of performance 
standards had improved slightly, Agriculture, HUD and Navy 
managers were still having problems establishing standards which 
were measurable in terms of quality, quantity and timeliness and 
that distinguished between performance levels. GAO noted tn |5 
most of Navy's standards were distinguishable. GAO further found 
that employees that it surveyed were generally satisfied with 
several aspects of their performance standards, i t e,, they- 
generally felt their standards were fair, tailored to their gob, 
and consistent with organizational goals. G^O concluded that the 
Director, OPM, should direct agencies to take appropriate Option 
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that will result in performance 'standard's that contain quality/, 
quantity and timeliness measures ^ndy distinguish , between 
performance levels. GftO further concluded that it is impartjant 
that agencies reemphasize the need for supervisors and 
subordinates to jointly establish performance standards (that _ 
contain (i) measures of quantity, quality, and t ini§linesfe f (2) 
are .consistent in difficulty , ( 3 ) accurately reflect employee 
duties and (4) distinguish between performance levels . _GA€F^ 
generally .concluded that ^without such emphasis ,' standards JLjpi 1 be 
less likely to be fair and atrcurate criteria by which to fff^^r 
/ judge performance. (pp. 25, 26, 36, 35, GAO Report) r ^ 

The Department of Defense concurs with this finding. 




FINDING C : Agencies Need To Improv e Standard-Sett inq Procedures. 
s gAO_ found that , although CSRA requires agencies to encourage 
* employee participation during the standard-setting process, to 
communicate per forma to employees at the beginning 

* pf each appraisal period, to take care to assure employees are 
Utreated fairly when standards for employees with similar jobs are 
established and to have standards that reflect individual job 
re 9^^??i ne ! 1ts J £ atT the three agencies reviewed, these procedures 
were not: always followed. GAO further found that many employees 
from Wavy and HUD were not satisfied with the amount of 
involvement they had in establishing their standards, although 
^most employees at Navy (75 percent) believed theirsupervisqrs 
considered their views when setting standards . GAO concluded 
that the Director, OPM should direct agencies to take appropriate 
§?tion that will result in requiring > rather than encouraging, 
employees to participate in the development of performance 
standards, and to receive them to the extent practicable at the 
beginning af the appraisal period, GAO further concluded that 
^^y^i^^tion pf standards early In the appraisal period can 
reduce the likelihood of disagreement and requiring a review of 
performance standards at the beginning of each appraisal period 
by pool managers or their delegates can improve the consistency 
and quality of standads. (pp . 31> 35, GAO Report) 



The Department of Defense concurs with- this finding. 



FINDING D : Mq^. Evaluation And Guidance Is Needed For Merit Pay 
System . GsAO fdund that OPM's efforts £0 evaluate various agency 
merit pay systems were limited arid sporadic. GAO also found OPM 
had not analyzed the cost and effectiveness o^, the merit 
pay system and cash aw^rd program nor published the results as 
required by law. GAO further tourid that-OPM guidance has not * 
ensured that all agencies'are using the cAsh award. program as an 
integral part of merit pay. GAO concluded that OPM efforts to 
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evaluate merit pay have been limited and not in compliance with 
the law. GAO- further concluded that the new organization 1 s f 
(Office of Performance Management ) evaluation strategy is 
: *:v<prbmisih9; however, because thei staff assigned to carry out the 
strategy is limited, it may experience difficulty in conducting 
the planned reviews. ( pp# 37 , 39, 40 , 41, 46, GAO Report) 

The Department of Defense concurs with this finding. 

FINDING — E : Agencies Save Identified gnd Corrected Some First 

Yea* 1 Problems . GAO found that all three departments it reviewed 
had eiraluted their merit pay systems, gathered atti-tudinal data 
r from employees pr supervisors about merit pay, and made changes 
to their, systems based on these evaluations. ._ GAO further found 
t^iat Navy 'changed its system for the appraisal period starting 
July 1982> because of problems it discovered-- i^e., ^simplified ^ ____ 
its appraisal forms and required fewer performance revievs during 
the year. GAO concluded that the -three departments Have made 
changes based on their evaluations of their merit pay systems and 
these actions weire steps in the right direction. j 
(pp. 44 , 47, GAO Report) , : $ 

The Department of Defense concurs with this finding, but 
recommends that an additional change made by the Department bf_ 

' the Navy be included in pa'ge^AS of the report. This additional 
change should be added to thK^list of flavy's changes and should 

^ be worded as follows : 



■ — Encouraged an up-front review of standards by Performance 
Review Boar&atfcp ensure equity among merit pay members 1 
standards ari<J\that the establishment of standards be 
timely. " ♦ > " • • \ . 

FINDING F : Employees Retain, Negative Perceptions of Merit Pay 
System . GAO found that in the three departments reviewed, 
employees' overall perceptions about merit^ pay remained 
negative — with most employees* including' top performers,. 
believing the system had not been .succ^ssful^ although slight 
improvements in Navy respondents 1 perceptions were noted after 
the .1982 yner.it pay cycle. GAO further found that generally 
employees w^re skeptical a^out the m^rtt pay systems intended 
benefits and believed that per f prmance/prodfect i vi ty and 
motivation had_not increased under merit pay, nor did .the 
benefits justify the, additional time to operate it. Further that 
while about one-third of the employees supported the concept of 
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merit pay, less than 10 percent of the respondents in eac f h 
Department wanted to retain the merit pay system as 
currently implemented . GAO concluded that 'after implementing two 
appraisal and pay cycles , enfployee accept artce has shown si ight 
improvement and that such improvements in altt i tude ( should they 
continue) may indicate a greater employee willingness to accept 
the system* if they perceive it as accurately and objectively 
linking ratings an<3 pay to performance, ( pp * 48-52 arid 55, GAO Report) 



The Department of Defense concurs with this finding. 



RECOMMENDATION -^ . GAO recommended that the Director, -OPM, .assess 
the impact of pool composition and agency formulas on merit pay 
increases and develop -criteria that will minimize their possible 
adverse effect, (p. 23, GAO Report) . 

The Department of Defense concurs with this recommendation, 

RECOMMENDATION 2 . GAO recommended that the Director, OPM — 
reemphasize the heed for agencies to establish separate merits pay 
pools for its career arid noncareer (Schedule C) employees , so 
that Schedule C employees do not receive larger merit increases 
at the expeftse of career emloyees. (p m 23, GAO Report) 

The Department of Defense concurs with this 'recommendation. 



RECOMMENDATION 3 .: GAO recommended that the Director, OPM enforce 
the regulations which prphibit forced distribution of ratings. 
(p^23", GAO Report) 

The Department of Defense concurs with this recommendation . 

RECOMMENDAT ION ^4 . GAO recommended "that the Director , OPM take 
actTorT~toTmprove per f brmance _ standards and the standard- set ting 
process by requiring pool managers or their delegates ±o review 
standards at tbfe beginning, of each appraisal period. This review 
should , assure that , to the maximum. extent feasible , standards 
contain the desired characteristics of objectivity ancl 
measur ability , arid that they are of comparable difficulty for 
similar jobs. (p. 36, GAP Report) _ . ' 

The Department of Defense concurs with this recommendation. 
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RECOMMENDATION -5 . GAG recommended that the Director , OPM< should 

require that performance elements and standards be jointly 

established by supervisors arid subordinates and be ? communicated 
to the employees within a spec i f led t ime from the beginning of 
the appraisal period. (p. 36, GAO Report) 

The Department of Defense concurs with this recommendation. 



RECOMMENDATION 6 . GAO recommended that the Director OPM, in 
order to improve the evaluation of the merit pay system and 
the administration of the cash award program, should ( 1 ) provide 
adequate resources to ma in tain planned merit pay evaluation 
efforts , ( 2 ) publi sh annual reports which analyze ..tn'e cost: and 
effectiveness of the merit pay system and cash award program, and 
|3^clarify the intended role of the cash award program for merit 
pay employees and provide guidance and oversight that will ensure 
that _it is _used as ah integral part of merit pay.- 
(p. 47, GAO Report) ' ' 

The Department of Defense concurs with this recommendation . 
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tlfZ^ United States 

i.'S* Office of 



Personnel Management Washington, d c 20415 

/ In RipJy Rffiff, Tn 




Your R*t«T«nr« 



Honorable Charles W. Bows her 
Comptroller General of the United States 
United States General Accounting Office 
Washington, D. C. 20548 



Dear Mr. Bows her : 

This is in response to your October^ draft report to the.Subcommittee on 
Compensation and Employee Benefits," House" Committee oh Post Office arid 
Civil Service, entitled "A 2-Year Appraisal of Merit Pay in Three 
Agencies," We have reviewed the report and would like to .take this 
opportunity to commend GAO on the thorough and comprehensive manner in 
which the review was conducted. 

The report recognizes that developing and implementing an effective 
merit Pay system cannot be done in a few years. Further, the report 
notes that compensation experts have stated that it may take 5 to 10 
years for a merit pay system to operate as intended. 0PM agrees with , 
the report's findings that there are. a number of problems within the 
existing Federal merit pay system,. 0PM is aware of these problems and 
has initiated actions to correct them. \ 

First, °PM has established a new Office of Performance Management which 
brings together under one director the previously separate programs of j 
performance appraisal, merit pay* and performance awards, including an 
analysis and evaluation responsibility. The improvement of performance 
standards and the morei^gffective use of .performance-based incentive 
systems in agencies is the major work of the Of f ice of Performance 
Management. The Office is responsible for overseeing the operation of 
performance appraisal and merit pay and awards program^ in agencies, for 
developing policies to improve performance^appraisal and merit pay in r 
the Federal Government, and for directing agencies to make changes. In 

t heir sy stems to b ri ng . t hem . in to com pliance with 0PM policies., the 

Office provides assistance to agencies in developing and operating their 
systems, reviews and approves performance appraisal and merit pay plans , 
and conducts reviews of agency systems. In addition, the Office 
develops formal policy (regulations and FPM material) and advisory or 
guidance documents such as model standards. 

On October 25, 1983, 0PM published in the Federal Register a 
comprehensive set of regulations dealing with performance appraisal, 
m ?r^ pay, awards, and a Performance Based Incentive System (PBIS>. 
Those regulations clarify and provide greater precision to policies 
regarding critical elements, performance standards, summary ratings, and 
the use of appraisal results in setting pay -and rewarding employees. * ' 
The revisions in the merit pay regulations enhance .compatibility between 
the Merit Pay and General Schedule pay systems, and further promote. the - 
linkage between the performance appraisal process, personnel decisions, 
and management planning .and decision-naking. 
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the new merit pay^reffulations provide "parity" For merit pay - 

employees.. "Parity*' means that all merit pay employee rated fully 

successful or better will receive the equivalent .of the General Schedule 
within-grade increase as well as the, f jfll general (comparability) 
increase. In addition, the regulations make performance awards a 
mandatory part of the merit pay concept. With ""parity" being^ granted to 
all merit pay employees, there will be only a relatively small amount ^ 
le'ft lii the ^Merit Pay Fund for distribution based on better than fully 
successful performance. In order to maintain a meaningful pay-for- 
performance system^ performance awards must be used on a regular basis 
to supplement increases to base pay as a reward for a high ^ level of 
performance. These changes should reduce_substantially the 'perceived 
inequities how associated with the Mei&it Pay System. " : 



•Our comments on specific conclusions and recommendations of the report 
are set forth below. ^ . ' 



The report concludes that OPM should "assess the impact of pool 
composition and agency formulas on- merit pay increases and develop 
criteria that will' minimize Eheir Adverse effects." Since the 
implementation of- the Merit Pay System in the* Federal Government in 
1980, OPM has _continiially rev*®??? ^d analyzed agency merit payout , " 
results. We are also aware of the; concerns expressed by \30me employees 
about the variation in merit increases due to the composition of the. 
pool in which the person is employed and . the kind of formula or matrix 
that the agency has determined is appropriate for its pay-for 
performance philosophy. Although the _3tatutbry requirement separate 
agency merit pay funds prevents the complete elimination of variability 
in merit increases among agencies, OPM has already taken several steps 
to address this problem withiri.an agency 4 . In April of 1982, we issued a 
memorandum through the Interagency Advisory Group (I AG) suggesting that 
agencies transfer funds from one merit pay unit to another to correct 
inequities in merit pay pools^t.hat are Ttot warranted by performances As 
a follow-on to the IAG memorandum, this concept is further developed in 
our reteehtly i^3ued regulations i oh Performance Management. In 
accordance with these regulations, agencies would be authorized to make 
adjustments in the method used to determine the funds available to each 

pool, within the agency in order to (1) reoognize organizational- : 

accomplishment, (2) adapt for unusual distributions of performance 
ratings, or (3) accommodate asterisked rate requirements. This change 
will enable agencies to grant more unifprm and appropriately 3ized v ,merit 
pay increases than at present. We intend to continue to evaluate ithe 
impact which pool composition and agency formulas have oh merit pay 
increases and to develop whatever additional guidance is necessary to 
assist agencies in improving their merit pay systems. « 



The report recommends OPM "reemphasize the need for agencies to 
establish separate merit pay pools for their career and non-career^ 
(Schedule C) merit pay employees, 30 that Schedule e employees do^t 
receive larger merit increases." OPM policy authorizes agencies to 
define the employee composition of their merit pay pools. We recognize 
the problem agencies can experience in the distribution of theirmerit 
pay funds when they have a number of non-career (Schedule C) employees 
in a merit pay pool with career personnel. In providing consultation to 

... . » 
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agencies on this matter 0PM has recommended, and will continue to 
recommend that, whenever feasible, career and non-career employees hot 
be included in the same merit pay^pools. However^ there are ^ 
circumstances when it is not appropriate to have separate pools, as when 
there is only one or two non-career merit pay^empioyees in the agency . 
Therefore, we will continue to emphasize in bur technical assistance to 
agencies* that they carefully consider the employee composition of their 
merit pay pool, particularly as it relates to inclusion of career and 
non-career employees in the same merit pay pool. 

The report also recommends that _OPM Should "enforce the regulation which 

prohibits forced distribution of rafcXngs." OPM r®998nizes_the; 

importance of thisfcrule and believes the prohibition of preestablished 

rating distributions helpa to ensure that employees are accurately 

appraised .against the standards for their positions. Our regulations 
reinforce the prohibition of . preestablished performance, distributions 
but would require that agencies provide for higher level management of 
the performance. appraisal process. in the interest_pf employee equity and 
in order to Reflect organs _. 
managers would be able to change inaccurate appraisals, but would not be 
permitted £o require a specific distribution that was established in i 
advance. Additionally, through its agency assistance, evaluation, and 
monitoring activities, OPM will wozfk diligently to see that this 
requirement is accomplished. 

'The report concludes that the Director of OPM "require that merit pay 
jJool managers review performance standards at the beginning of the 
appraisal period to assure thatT, to the maximum extent feasible, they 
contain the desired bharacterrsticspf objectivity and measurabiiity and 
that they are of comparable difficulty for similar jobs." Our new 
regulations require that critical elements, non-critical: elements , and 
performance standards shall be in writing and shall be reviewed and 
approved by a .supervisor or manager at a higher level than, the 
appraising official^ This requirement will P^vide for a 'stronger role 
for higher level managers. and supervisors .(including. merit pay pool 
managers) in the appraisal process^ specifically including the review of 
performance standards at the beginning of the period^ not_oniy for the. 
reasons stated but to ensure also that they accurately reflect the goals 
-and- misstons-of -the— organization". — Our ^regu ration s will also "require 
that a supervisor or manager at a higher level than the appraising 
official review and approve ratings before they are made final and 
communicated to- employees. We agree that the importance of the 
performance appraisal process demands an active, role for aij levels of 
management • 



With respect to the recommendation that OPM should "require that 
j '—performance standards be. jointly established by supervisors and 
\ subordinates," we strongly believe that employee involvement is 

fundamental to the success of the performance appraisal system. Making 
it a requirement tJtiat there be direct supervisor-employee communication 
during the standards-setting process is an excellent idea. Our new 
regulations state , "an agency shall encourage employee participation in 
establishing performance standards." (emphasis added) However , we are 
concerned that the recommendation , as written , could be interpreted to 
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mean that agencies wOOl4 be required to jointly negotiate standards with 
employees and that management and employees must, reach agreement on 
their content. It is our position that establishing performance - 
) standards is an integral part of management's right to assign work. We 
suggest, therefore, that this recommendation be changed to read_, 
"require that agencies encourage* employee participation in establishing 
/performance standards." 

With respect to the recommendation' that OPM should "require that 
standards be communicated _to employees within a reasonable arid specified 
time from the beginning of the a p|raisal period", such a requirement 
already exists in nearly all agency plans and implementing procedures, 
and pur newly published regulations also require that agencies provide 
written Performance Plans to employees at _ the beginning of each 
appraisal period. We fully expect that OPM's oversight an^dbriitor irig 
activities will help to ensure that this requirement is m&t . K 
• - - - * 

The report recommends that 0PM .^provide adequate resources t$ maintain 
its planned merit pay evaluation efforts." We concur, with/this . 
recommendation and also with GAO's comments on the necess/ty of having a 
' comprehensive evaluation program. As stated earlier, the/ Office of 
Performance Management was .established to improve upon performance 
standards and to promote effective utilization of performance-based 
incentive philosophies in the agencies. In accomplishing this mission, 
this office relies heavily upon an analysis arid eyaluatipn function 
conduct program evaluation as it leads and directs the Government-wide 
areas of the performance award and merit pay programs. _ This functional 
responsibility rests with the Analysis and Evaluation Division .of the 
Office of Performance Management. 

* _ ■ _ _■ ^ >_ ■ . _ 

Our Evaluation efforts were initiated during fiscal year 1983 and have -- 
been in place for less than twelve months . Studies accomplished by the 
Analysis and Evaluation Division during the past year, while 
comprehensive, were limited to a small start up. effort and a small 

* j number of agencies. We concur with GAQ's recommendations that 

additional efforts must be expanded toward the analysis and evaluation 
of performance management programs if future improvements in 'these ' 
programs are to be expected T To that end we intend to significantly 
increase our program evaluation efforts in the .review of Government -wide 

— - per fcraa^e- management p rogram^j^fati 

help and cooperation of OPM's Agency Compliance and Evaluation Group, 
CAGE) our ' analytical, and evaluative .efforts planned for FY^1984.will > 
focus* on: (1) a systematic review for effectiveness of performance ^ y 
management programs being implemented and administered. ift._ the agencies 
via specific agency on-site as well as Government-wide reviews. Some of 

. this effort will be handled by the nationwide network of AGE in concert 
with' the Office of Performance Management; (2) using available 
information sources including this year's program results, identifying 
areas where Government -wide improvements of Performance Management 
Systems are needed and initiating special program studies. Some of 
these studies will be narrow in^scope and address specific problems in > * 
selected agencies . Others will be more comprehensive, Government-wide, 
arid focus on problems that may have policy impact; and (3) intensifying 
our efforts to improve the accuracy and timeliness of existing data 
bases such as the Merit Pay Management Information System to provide an 
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analytical and evaluative information source from which; OPM "can identify j 
operational problems and provide a solid _ basis upon which corrective 
courses of action in agencies can be initiated, 

. / '. . ... _ . . - ■ . _* _ _ 

Additionally, efforts will be started to lay the ground work for. the ; 
agency development of self assessment procedures for performance 
management programs while stressing the relationship of performance 
management programs to the total personnel management process. While 
trite performance appraisal system is the basis upon which merit pay 
decisions are made, agencies are also > required to utilize the results of 
5!*®_P^? 0 r m §DP^ i fi ^ ne other areas of the personnel 

- management process p" The methods by which the performance appraisal 

results can be ; linked to the training, ( Promoting^ rewarding^ ' 

reassigning, reducing-in-grade , retaining and removing of employees have 
not/ been emphasized in the past by OPM and almost totally left to the 
discretion of the individual _agenciee. _ The Analysis and Evaluation 
DivisTon of the Office of Performance Management will accomplish an in- 
depth Government-wide study to determine to what extent the Integra t ion * 
of performance management and personnel management programs has occurred 
and assess the overall thoroughness and effectiveness of existing 
linkages. This effort will involve a sampling of agencies and cover the 
agency headquarters as well as regional installations. 

The report recommends that OPM "clarify the intended role of the cash 
award program for merit pay employees and provide guidance to ensure 
sthat it is used as an integral part of merit pay." In developing our 
r?Yi?? d _ r ?iyi??i9 ss i _9? M determined that performance awards shoald 
become a maridatoxy part of the Merit Pay System. The regulations _ 
provide that ^ age|icies _must include in their Perform^ice *^§ge_niiBht Plan, 
for approval by )DPM, the way in which performance award funds will be 
distributed and the amount to be funded by the agency for suck : 
purposes. OPM WjLll specify the minimum funding level for merit pay 
performance awards ; ' ; 

In response to the reconmendation in the report that OPM^publish annual 
reports which analyze the cost and Effectiveness of the Merit Pay System 
arid Cash Award program," we* would like to make the following cdmmehts : 

a) OPM consistently runs ah approval process and continually moni- 
tors^ ^yoite in- order to ensure^ that neither more^nor less soney 
is spent in^the Merit Pay Program for QM employees than would 
: have Been spent under the General .Schedule. __We have pay tota 

resident in our Merit Pay Management Information System (MPMIS) 
• „; to track this.. Also \ since the amount that would have been paid 
m ®ri?_P§y ©?Ploy??s_for _within-grade increases .quallty^step 
increases, and the non-automatic portions of comparability - 
increases are put into a pool for distribution, the total amount 
distributed is the same as it would have been under a GS system, 
although the specific amounts paid to each employee vary by 
performance rating. Our Merit Pay Statistical Report shows how 
agencies actually do their payouts and also contains selected 
data on how the Merit Pay Program is working, but there is no 
need to address total cost of the payouts since it is keyed to 
the total costs that would have occurred under the General * 
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b) Both OPM Central and Regional- offices are currently involved in 
performing the following studies to determine how effectively the 
Merit Pay Program is achieving the objeafc£*es of the' Civil 
Service Reform Act: - - t 

The Merit Pay Statistical Report, 1983, explores the rela- 
tionship of pay ajid performance awards to performance ; 
ratings; it also serves jointly as a reporting; mechanism to 
central management agencies' arid also as a source of feedback 
for operating agencies. j* 

There are three 1 other: studies being performed by our Program 
Evaluation Branch, which include surveys and document 
searches performed nationwide by OPM Central and Regional 
office personnel, arid are due to produce results by the end 
of the calendar year. 

We 'believe that OPM is I responding to this , n cost and effectiveness" 
recommendation. We have plans for several other more directed studies 
to determine how well Merit Pay and Performance Appraisal programs have 
been working since the passage ^ of the Civil Service Reform Act. 

Thank you Vor this opportunity to respond to and comment on the proposed 
report. We believe that our new regulatory tnttiatives relative to 
performance management will result in better management of the Federal 
Government's work force. 

v Siricerely^oiirs, 



Donald J. Devine 
Director 
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